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II. THE PREDICTION OF TALENT FOR VOCAL EXPRESSION IN 
READING 


The extension of the principles and technique of vocational 
psychology into the field of vocal expression is a new venture. 
Indeed, the use of psychological tests for determining artistic 
capacity and aptitude in any line is a most recent phase of the 
movement for vocational guidance. Seashore, in his tests of 
musical talent, blazed the trail. The objective in the experi- 
mentation herewith set forth was the assembling and weighting 
of a battery of tests which would give a significant coefficient 
of correlation with a criterion adequately representative of 
capacity for vocal expression in reading. 


Preliminary analysis of the problem 


One fundamental consideration to be borne in mind con- 
stantly is that vocal expression can be measured by only one 
standard: viz., its effect wpon listeners. Vocal expression is some- 
thing to be perceived, Something to be reacted to, and if we 
would appraise it, we must do so by measuring the reactions of 
listeners. In the field of aesthetics, ‘there is nothing good or 
bad but thinking makes it so.”” Woolbert? proceeded upon this 
fundamental assumption. By implication at least, he says 
that one measure of vocal effectiveness is the permanence of its 
impression upon the listener. In the present study it has 
been taken for granted that vocal expression which is adjudged 


1 Continued from the March number. 
*C. H. Woolbert, Effects of various modes of public reading. Journal 
of Applied Psychology, June—September, 1920. 
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to be good, bad, or indifferent by a representative group of 
listeners 7s what it is adjudged to be. 

There is need for a much more comprehensive experimental 
study than has yet been made of the reactions of listeners to 
different types of vocal expression. Of course it may be as- 
serted that the degree of skill indicated in a given bit of vocal 
expression is to be determined by measuring the proficiency 
shown in the use of each of the four elements of vocal sound; 
viz., force, quality, time, and pitch, but this is merely to restate 
the problem by breaking it into four pieces. Gordon and 
Lyman say: “In vocal expression, thought must seek an outlet 
through voice which thus becomes an object of study. 

It follows then that in the elementary qualities and 
attributes of sound a basis may be found for the study of vocal 
expression.” And again, “These natural ways of uttering 
thought or emotion through the voice are of four kinds: melo- 
dic, qualitative, temporal, quantitative.’”* This represents 
the traditional answer to the question: what is vocal expres- 
sion?—traditional, at least since Dr. James Rush wrote his 
Philosophy of the Human Voice, now nearly a century ago. 

That there is help in this analysis of vocal expression into 
its physical elements, no one will deny. Its limitation is that it 
usually fails to distinguish between the physical elements of 
sound and their psychological correlates. The reactions of 
the listener to each of these elements, and more particularly to 
the fusion of them—a fusion made up always of four variables— 
are but slightly understood. 

We now come to the question: what are the factors involved 
in the production and control of the complex activity compre- 
hended under the term vocal expression? Or, more simply 
stated, what, so far as vocal expression is concerned, makes an 
effective reader? 

The reply of most writers on vocal expression would be sub- 
stantially as follows: Skill or ability in vocal expression de- 
pends upon an adequate, present understanding and appre- 


*H. Gordon and R. L. Lyman, Vocal Expression in Speech. Ginn 
and Co., 1911, p. 18. 
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ciation of the meaning of the language uttered—both as to 
ideas and feelings, thoughts, and emotions; trained vocal 
organs capable of revealing this understanding and apprecia- 
tion to the listener; and a proper conception of the reader’s 
relation to the listener. This statement may be true but it is 
inadequate and somewhat superficial. 

Scripture analyzes vocal control into the following factors: 


. Reflex tonus 
. Force of movement 
. Accuracy of movement 
. Precision of movement 
. Accuracy of coérdination 
6. Quickness of response 
7. Quickness of movement 
8. Forms of sensory-motor control 
9. Ideo-motor control 
10. General voluntary control‘ 


One can scarcely read this list without noting some of its 
obvious defects. Despite Scripture’s rather labored attempts 
to differentiate these ten factors. it remains dubious whether 
3, 4, and 5; also 6 and 7 are not essentially identical. How- 
ever, the analysis is fundamental and, when understood, it 
proves highly suggestive. 

Before giving a tentative analysis of vocal expression, it 
may perhaps be well to quote Seashore as to the principles and 
considerations which guided him in a similar undertaking. He 


Says, 


In making an inventory of the musical mind, we are guided by two 
coérdinate bases of classification: first, the attributes of sound; and 
second, the generally recognized powers of the human mind. , 
Our classification of items will, therefore, be a list of those traits of the 
human mind which are necessary for the apprehension and expression 
of the recognized attributes of sound. These are: the hearing of tones, 
the production of tones, the representation of tones in memory and 
imagination, musical thought, and musical feeling.® 








‘E. W. Scripture, Elements of experimental phonetics. Yale Univer- 
sity Press, 1902, p. 382. 

' CG. E. Seashore, The psychology of musical talent. Silver, Burdett, 
and Co., 1919, pp. 6 and 7. 
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It should be remembered that we have restricted the mean- 
ing of the term vocal expression to vocal expression in interpre- 
tative reading, and that we are here engaged in the attempt 
to analyze the talent or capacity for such vocal expression. 
It seems to me that the following factors must be significant in 
this composite ability, talent, or capacity: 


. General intelligence 
. Emotional responsiveness 
. Neuro-muscular coérdination 
a. Motility 
b. Accuracy 
. Audition 
a. Sense of pitch 
. Sense of force 
. Sense of time 
. Sense of consonance 
. Memory for tones 
. Sense of rhythm 


It will be seen that, in respects which I have tried to make 
clear, I am indebted to both Scripture and Seashore for this 


analysis. It seems certain that any attempt to predict talent 
for vocal expression in interpretative reading will involve the 
use of tests which measure some or all of the factors suggested 
here. 


The criterion 


Nothing need be said here regarding the importance of the 
criterion in vocational and aptitude tests. It is patent that 
the worth of any test or battery of tests depends upon the 
character of the criterion with which they are correlated. Un- 
less the criterion actually represents the ability or the aptitude, 
statistical computation is but vanity. 

In order that those interested in this study may have com- 
plete evidence upon which to base a just opinion as to its valid- 
ity, the criterion is described in considerable detail. 
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The subjects 


The subjects were two hundred ten young men from ten 
different sections of the course in “The Elements of Public 
Speaking” at the University of Wisconsin. The young women 
in these sections were eliminated from the tests in order to 
avoid constant errors from sex differences. There were doubt- 
less inequalities in speech training which could not be compen- 
sated for or avoided in the testing, but so far as school training 
in vocal expression was concerned there were no marked differ- 
ences. ‘Training in vocal expression is a less controllable vari- 
able than training in most other school subjects. 


The material read interpretatively 


Austin Dobson’s poem, ‘“Tu Quoque” which was used in the 
experiments described in the former paper® was read by each 


of the subjects. Two days prior to the reading, the experi- 
menter gave each subject a mimeographed copy of this selec- 
tion and asked that careful preparation be made for the vocal 
interpretation of the material. 


Judging 


As each subject read the assigned selection he was judged 
by every other student in his group. Thus, if there were 25 
subjects in a given group, there were 24 judgments on each 
reading. ' 

Each member of each group was given a ballot on which to 
record his judgment of the vocal expression of the several 
readers. At the top of each ballot were the following 
instructions: 


You are to give each reader a percentage grade on vocal expressive- 
ness. If two readers seem absolutely equal to you, give them identical 
percentages. Try, however, to apply the same standard of vocal 
expressiveness to all and to make as fine distinctions as possible, using 





* Andrew Thomas Weaver, Experimental studies in vocal expression. 
Journal of Applied Psychology, March, 1924. 
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fractional percentages if necessary. After you have assigned percentage 
grades to all readers, excluding yourself, proceed to rank them from best 
to worst on the basis of the percentages. 


The experimenter made sure in each case that the instructions 
were thoroughly understood. 

All was now in readiness for the series of readings. As the 
experimenter called off the names of the individuals within 
the group, they were set down on the ballots and the readers 
proceeded to the rear of the room where a reading stand had 
been placed. The members of the group had been instructed 
not to turn their heads so as to see the reader during the read- 
ing. Thus the influence of the visible symbols of speech 
facial expression, posture, movement, and gesture—was elimi- 
nated from the judgment. Some visual memory images of 
the readers’ previous appearances before the class may have 
been reinstated by the auditory stimulation, but there was no 
way of eliminating this possibility in a group more or less 
acquainted with each other. In any event, if this factor influ- 
enced the result, it must have operated to attenuate the cor- 
relation between the criterion and the tests rather than to 
increase it. 


Compounding the judgments 


When all of the ballots had been properly marked they were 
collected and the ranks were combined into a composite group- 
ranking. ‘The ranks assigned to each reader were added 
together and the readers were re-ranked on the basis of the 
sums thus obtained; the first rank being given to the reader 
with the smallest total of ranks; second, to the next larger, and 
so on down to the lowest rank. Rank 25 in a group of that 
number was of course assigned to the reader with the highest 
total of ranks. 

There were several reasons for combining the ranks instead 
of the percentages; the principal one being the disparity of the 
scales used by the different judges. It was felt that individual 
judges handle percentage grades so differently that there would 
be greater definiteness of meaning, and more of common value, 
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in ranks than in percentages. Then too, it seemed difficult 
if not impossible to get a sufficient spread in the percentage 
grades. Most students, like most teachers, always think of 
percentages in terms of school grades. They tend to fix the 
lower limit at 70 or 75 and the upper at 93 or 100. Perhaps 
if Professor West’s studies in Judging’ had been available 
when these experiments were under way, a satisfactory use of 
percentages might have been possible. It may well be added 
that the use of percentages involves perplexing questions when 
we attempt to combine different smaller groups into one large 
group as was necessary in this case. 


The conversion of ranks into linear values 


As explained in the preceding section, it was essential 
that some method of combining the smaller groups of subjects 
into one large group be found, if coefficients of correlation were 
to have any high degree of reliability. Since the groups were 
of unequal size, this problem seemed well nigh insoluble. Given 
unselected groups of unequal size, how was it to be determined 
just what the different ranks meant on a common scale? 

Moreover, so long as our data is in terms of ranks we are 
restricted to the use of such coefficients of correlation as may 
be computed from ranked data: viz., Spearman’s and its deri- 
vatives. There has been a good deal of question among statis- 
ticians as to the value of Spearman’s coefficients and a growing 
insistence upon the use‘ of a formula which takes into account 
the amount of differences in scores or grades as well as the order 
of ranks; viz., Pearson’s products-moment method. 

Moreover, it is held to be improper to use Spearman’s 
coefficients in the regression equations which have been 
developed for weighting tests. Therefore since the criterion 
is so frequently a series of ranks, some method had to be worked 
out for converting ranks into measures available for use in 
Pearson’s formula. Hull has made possible the solution of 


7R. W. West, Methods of computing contest scores. Quarterly 
Journal of Speech Education, October, 1919, pp. 319 to 333. 
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both problems confronting us at this point; viz., the combining 
of the several groups of subjects into one large group and the 
computation of Pearson’s coefficients of correlation from ranked 
data.* These things are accomplished by a formula for con- 
verting ranks into linear values on a common scale. Hull says: 
“Tn translating the ranks into linear units, it is assumed that 
the ability in question is distributed according to the law of 
probability. . . . . Of course this is only approximately 
correct, but it is exact enough for practical purposes.”’ The 
formula is: 
100 (¢ — 0.5) 


7 


Per cent = 


where c = the ranks of a subject and n = the number of sub- 


jects in the group. ‘The per cent value is roughly a percent- 
age expression of the distance in rank of a given subject from 
the extreme of the distribution ranked as no. 1.” In this 
experiment, a 100 point scale was used. The ranks within each 
group were converted into these common linear values and 
then the groups were all put together assigning to each subject 


his score on the common 100 point scale. Hull gives a con- 
venient table for the conversion of ranks into linear values. 


The reliability of the criterion 


As already stated, no argument is needed to prove that the 
validity and reliability of the measures constituting the crite- 
rion are of basic importance in the attempt to set up tests of 
any aptitude, skill, or capacity. Have we described a criterion 
which is essentially valid and reliable? 

No ready and simple answer can be made to this vital query. 
I take it that no incontrovertible evidence can be adduced to 
establish the reliability of any criterion which is constituted 
out of the opinions and judgments of human beings when there 
is no objective reality with which the judgment can be compared. 
If we have a series of weights varying from one to another by a 


*C. L. Hull, The computation of Pearson’s r from ranked data. 
Journal of Applied Psychology, December, 1922. 
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just perceptible increment we can tell how reliable the judgment 
of a given subject or group of subjects is by a comparison of 
the judgment with the objective reality—the series of weights. 
But obviously there is no such simple way of determining how 
accurately an individual or a group of individuals judge ability 
in vocal expression. Here we are dealing with an intangible 
quantity of a different order. Vocal expression is an aesthetic 
matter. It involves, if indeed it does not subsist in, the hearer’s 
reaction and consequently excellence in it may be said to exist 
only in the hearer’s opinion. 

Therefore, it would seem that the only possible test of our 
criterion must be: does it accurately represent the opinion of 
hearers in general? If it does, who shall gainsay its validity? 
The one available way of determining the quality of the com- 
posite judgment which is to represent talent for vocal expres- 
sion is then the testing of this composite as to its consistency 
within itself. 

The extent of agreement between the composite judgment of 
one-half of the group and the composite judgment of the other 
half, furnishes some basis for an opinion as to the degree of 
probability of agreement between the judgment of this whole 
group and that of another whole group. Accordingly group 
judgments were split in two. To illustrate: if there were 24 
judges, the procedure was as follows: 

1. The group of judges was divided into two groups of 12 
each. _ 

2. The ranks assigned to each subject by the twelve judges 
in each of the two sub-groups were added. 

3. The subjects were re-ranked on each sub-group’s total of 
ranks. 


4. The ranks representing the two judgments on each sub- 
ject were converted into linear values. 

5. The coefficient of correlation between the two composites 
representing the two sub-group’s judgments was computed. 
(Pearson’s products-moments formula). 

This computation was made for five representative groups 
with results as shown in the following table. 
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rT BETWEEN TWO 
SUB-GROUPS 


+0.922 
| +0.912 
| +0.918 
| 


GROUP NUMBER IN GROUP 


| 
-_. r 
| 


+0.932 
+0 .962 





Does it not seem a warrantable assumption that, if the judg- 
ment of the stnaller sub-groups agree to this extent, the judg- 
ment of another whole group on the data in question would 
agree even more closely with the judgment of this whole group?® 
And if so, have we not a reasonably reliable measure of vocal 
expression? 

Some one may raise a question as to the expertness of the 
judges. It may possibly be urged that the criterion should be 
made up from the judgments of those competent to express 
an expert opinion as to what constitutes effective vocal expres- 
sion. In answering this objection, we may well inquire as to 
whether an opinion which fails to conform to the judgment of 
a group of intelligent people can be accepted as expert and, if 
so, in what sense. I think that we may safely conclude that 
our criterion expresses with a reasonable degree of accuracy 
the typical judgment of intelligent persons as to what vocal 
expression in reading means. 


The tests 


In choosing the tests to be tried out in the attempt to build 
up a battery which should show significant correlations with 
our criterion, several general considerations had to be kept in 
mind. First, it was felt to be impracticable to use individual 
tests. It would have been impossible in any reasonable amount 
of time to test a number of subjects large enough to give any 
high degree of reliability to the correlations which might appear 
Then too, the usefulness of any battery of vocational or apti- 


®*K. Gordon, A study of aesthetic judgments. Journal of Experi- 
mental Psychology, February, 1923. 
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tude tests is directly dependent upon their availability for 
group use. 

The second principle which guided in the choice of tests was 
that of simplicity of technique in giving and scoring them. If 
tests are to be of any general usefulness they must be easy to 
give and easy to score, and they must have some range of adapt- 
ability with respect to the size of the groups which can be 
tested. 

Finally, tests which seemed to offer the possibility of dupli- 
cating each other were avoided. The aim, as in all similar 
cases, was to assemble a battery of tests which should yield the 
highest possible correlations with the criterion and, at the same 
time, the lowest possible inter-correlations among themselves. 

It was obviously impracticable to attempt tests of all the 
factors noted in our tentative analysis of vocal expression. 
Leaving out the second and third categories, General Intelli- 
gence and Audition remain and these were the peculiar objec- 
tives in the selection and use of the various tests which were 
tried out and from which the battery was finally assembled. 

Two tests of general intelligence were essayed; viz., Army 
Alpha and Terman’s revision of the Binet-Simon word list. 
After some preliminary experimentation, the former was aban- 
doned in favor of the latter. Computations showed that the 
army test was not more closely related to the criterion and that 
it was substantially duplicated in the simpler vocabulary test. 
It was not difficult to foresee the negligible advantage which 
would result from thé combination of these two tests between 
which the coefficient of correlation is in the neighborhood of 
+0.60. 

For measuring the various phases of audition the most promis- 
ing available tests were Seashore’s group measures of musical 
talent. The phonograph records, (A7536, A7537, A7538, 
A7539, and A7540) issued by the Educational Department of 
the Columbia Graphophone Company make possible group 
measurements of sense of pitch, sense of intensity, sense of time, 
sense of consonance, and tonal memory. 
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Thus the tentative battery of tests was narrowed down to 
the vocabulary test and the five Seashore phonograph tests. 
All of these tests can be given expeditiously and effectively to 
groups of any size by any experimenter whether he is particu- 
larly skilled in the technique of psychological testing or not. 

The instructions given in connection with the vocabulary 
test were as follows: 


You are to indicate your knowledge of the meaning of each word on 
the list by filling in the blank space after the word in one of three ways: 
with a definition of the word; with asynonym; or with asentence, clause, 
or phrase in which the word is correctly and unambiguously used. If, 
from what you write, it is not reasonably certain that you know the 
meaning of a word, it will be marked wrong. 


TABLE 1 





LOWEST | HIGHEST 





ee 40 

Sense of intensity 61 
Sense of time 53 | 
Sense of consonance............ 44 | 
Tonal memory 12 . pe 








Vocabulary 42 
Criterion 11 


| 
| 





The subjects were given as much time as necessary to fill in 
the whole list. This usually required the greater part of one 
class period (fifty minutes). It was not thought necessary or 
helpful to check the time factor in the tests. 

One examiner marked all of the vocabulary tests in order 
that there might be a minimum of variation in the standard of 

correctness applied. The score is the number of correct answers. 

The Seashore tests were given in strict accordance with the 
directions in the manual of instructions furnished by the Col- 
umbia Company with the phonograph records. In the pres- 
ent experiment each of the five tests was given twice and the 
score assigned to each subject was the average of his two scores. 

In table 1 are presented the lowest and highest scores, the 
means, and the standard deviations, in the five tests and the 
criterion. 





EXPERIMENTAL STUDIES IN VOCAL EXPRESSION 171 


Coefficients of correlation of the zero order 


As in all similar cases, we must first compute all possible 
zero order coefficients of correlation between the criterion and 
the tests and among the tests themselves. 

The formula used is an adaptation of the standard Pearson’s 
products-moments formula: 


Mas — ( M. x Ms, ) 
i" ' alae ? 
vVM,.—M, VM,,— M 


B 


This formula yields values absolutely identical with those 
obtained by the use of the standard formula and it has obvious 
practical advantages. It may be observed that the two radi- 
cals are respectively the equivalents of the two standard 
deviations. 

The following table shows the complete list of zero order 
coefficients. 





| b € 
SENSE OF | SENSE OF | SENSE OF | “aaa | TONAL | VOCABU- 
PITCH |INTENSITY| TIME | NaNce | MEMORY LARY 


} 


| 





Vocal expression. . | +0.4847|+0 1817| +0. 1940|+0.3170| +0 3498) +-0.2742 


Sense of pitch +0 3179| +0 3029|+0.7780| +0. 5224) +0. 2462 

Sense of intensity | +0.2257|+0.2412/+0.2018/—0.0082 

Sense of time |+0.4781|+0.2790) +0 .0782 
Sense of conso- | 

| |+0.7530| +0.3533 

+0.2754 





A casual inspection of the above data at once raises the ques- 
tion as to whether it is worth while to attempt a combination 
of all of the tests in the proposed battery. The most dubious 
candidate for inclusion seems to be the sense of consonance test. 
The correlations of this test with the others are so high, 
particularly with sense of pitch and ional memory, that it is 
extremely doubtful whether it would add anything to the pre- 
dictive value of the combination. Some preliminary computa- 
tions showed clearly that it would not, and consequently it 
was dropped from consideration. 
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After the elimination of the sense of consonance test the six 
remaining variables are: 


. Criterion (vocal expression) 
. Sense of pitch 

. Sense of intensity 

. Sense of time 

. Tonal memory 

. Vocabulary 


The zero order coefficients of correlation are: 


ria = + 0.4847 

rua = + 0.1817 ra = + 0.3179 

ru = + 0.1940 ra = + 0.3029 ru = + 0.2257 

ris = + 0.3498 ro = + 0.5524 rs = + 0.2018 rw = + 0.2790 

rie = + 0.2742 res = + 0.2462 rss = — 0.0082 rag = + 0.0728 roe = + 0.2754 


Coefficients of multiple and partial correlations 


It was thought to be advisable to compute the coefficients 
of multiple correlation, (R), for variables 1-5 inclusive and for 
variables 1-6 inclusive, and to work out regression equations 
and prediction formulae for each of the two groups of variables. 


A complete list of the partial coefficients needed for these 
computations is herewith presented. 


Partial correlation coefficients of the first order 


= +0.0332 T45.2 = +0.1482 To3.5 = +0.2539 
= +0.0565 T46s.2 = —0.0019 24.5 +0.1917 
= +0.1293 Ts6.2 = +0 1772 T 26.5 +0.1245 
= +0.1827 T12.5 = +0.3774 134.5 +0.1800 
+0.1429 T13.5 = +0.1210 136.5 —0.0677 
+0.0440 Tua.5 = +0.1072 746.5 — 0.0043 
—0:0941 Tie.5 = +0.1975 715.6 +0 .2966 


Partial correlation coefficients of the second order 


= +0.0523 T12.45 = +0.3654 T12.35 = +0.3611 
+0.1280 Ti3.45 = +0.1039 T1635 = +0.1910 
+0 1867 . T1645 = +0.1990 T2435 = +0.1534 
+0. 1434 Te: 45 = +0.2271 T26 36 +0. 1468 
+0.0116 T2845 = +0.1276 746.35 +0.0079 
+0.1823 T:36.46 = — 0.0680 714.56 +0.1101 
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Partial correlation coefficients of the third order 


114.235 = +0.0345 T 15.2324 = +0.1219 Yes.345 = +0.1470 

16.238 = +0. 1494 716.234 = +0. 1863 T12.456 = +0 3499 

rys.235 = —0.0149 rs6.234 = +0.1825 ris.4s6 = +0.1200 

713.245 = +0 0230 T12.345 = +0 3527 123.456 +) 2383 
T16.245 = +0.2076 


Partial correlation coefficients of the fourth order 


12.3456 = +0.3333 T 14.2356 = +-0.0326 746.1238 = —0.0203 
Ti3.2458 = +0.0402 715.2346 = +0.0909 Tse.i224 = +0.1637 
T16.2345 = +0. 1684 


There are always two ways of writing the formula for the 
coefficient of multiple correlation.” For five variables these 
are: 

eee pT pee a gee ea gee 
o = _ — —- ss — \ 
Q) Riga) =VI-(1-rF)a-r ad-F d=r 


(2) Riau =Vi- =F) =F )Gd=F dF) 


14-23 
In the present instance the two formulae yield: 


(1) R = +0.4969 
(2) R = +0.4920 


respectively. The slight discrepancy is doubtless due to 
dropping off decimals. Thus it may be foreseen that the 
four tests when given optimum weights and combined will 
yield a coefficient of correlation with the criterion about 0.01 
higher than does the first test singly. 


The two writings of the multiple correlation formula for six 
variables are: 
ee SET. eT ae eT ee 


rT 
14-55 13-456 12-3455 


(2) Rigs) =VI-(-r)a-—r ja-rja-r jar 





0G, U. Yule, Introduction to the theory of statistics. 
Griffin and Co., 1919, pp. 248 and 249. 

Curt Rosanow, The analysis of mental functions. Psychological 
Review Monograph Supplements, Vol. XXIV, No. 5, pp. 17 to 20. 


Charles 
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These yield respectively : 


(1) R = +0.5200 
(2) R = +0.5203 


indicating that the addition of the vocabulary test raises the 
predictive value of the battery approximately 0.025. The 
gain over the correlation between the criterion and the first test 
is disappointingly slight. It shows that when the correlation 
between one test and a criterion is very high, it is impossible to 
raise the correlation substantially if additional tests have any 
considerable tendency to correlate with the first test.” 


Partial standard deviations 


In preparing for the solving of the regression equations for 
the two sets of variables, we next proceed to compute the neces- 
sary partial standard deviations. The standard deviations for 
the six variables may be found in table 1 

tosanow gives formulae for five partial standard deviations.” 
Those for six partial standard deviations written by analogy 
from Rosanow’s formulae are: 


Cue = OVi-r Vi-r Vi-r  vi-rvi-*,, 
Orme =O2VI-e VI-r Vi-f  vi-n were 


T. 456 


Crs = OxVI— re vi-r, vi-#, vir a VI-3 


Ts. 2456 





Orson = 04 Vv1— " vi — Tu v1 — bn vi-r wvi-r 


14-235 46.1235 





Gs.208 = osV1 — = . v1 — -~ . ; vi-r - V1 - on V1 -r 


56-1284 


Goi = ogV1 —r — ua ivi-r -™ ‘ v= _ r ryt V1 —_ r’ 


Ts. 345 16-2345 





The formulae for the partial standard deviations yield the 
following values for the five variables: 


1 ©. L. Hull, The joint yield from teams of tests. Journal of Edu- 
cational Psychology, October, 1923, pp. 396 to 406. 
122 Curt Rosanow, op. cit., pp. 39 to 45. 
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01.2345 = 16 2660 
2195 = 8.3352 
03.1245 => 5 3887 
04.1235 = 5 7995 


O5.12324 = 14.4003 
and the following values for the six variables: . 


1.23456 = 16 0258 
2.13456 ol )47 
3.12456 5.3531 
4.12356 5.7983 
5.12346 . 2027 
6.12345 9.0878 


Regression equation and prediction formula for criterion and four 
tests 


We are now in possession of all the data needed for the solu- 
tion of the two regression equations which have been our ulti- 
mate objectives. Let us first write and solve the equation for 
five variables. The formula follows: 

F.234 


° o CO, na 

1.2845 1-2345 1.2845 

X11 = Tiras Xo + Ti3.245 = Se+ fires Lat Tiss — 2% 
Fo.1345 Os.:245 O 5.323 5.1234 


When the proper values have been substituted in this formula, 
we have: 


x1= 0.6883x. a 0.0694x; ao 0.0967 x4 _ 0 1377xs5 


Before rewriting this equation in the form useful for work 
with the raw scores, (X) we may correct the weights in such a 
way as to restore the original distribution of the grades on the 
criterion. Theoretically our o on the criterion should be 20. 
In the present case it was 18.77. This is the first factor for 
which we must compensate. More important than this, 
however, is the condensation of the prospective distribution 
which would result from the use of the weights just obtained 
for prediction purposes, due to the fact that the coefficient of 
multiple correlation, (2) is 0.4969 instead of 1.00. If we should 
attempt to use the weights just obtained to predict scores on 
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the criterion we should find ourselves unable to predict either 
any very good or very poor readers—our weights are too small 
to spread the predicted scores out toward the extremes as we 
find the actual scores spread.** 

Therefore, we restore the original spread by multiplying 
each of theweights by a constant term obtained from the fol- 
lowing formula: 

a", 
c= Ro, 

Where c = the constant term; o’: the standard deviation 
desired in the predicted scores; o; the actual standard devia- 
tion of the original criterion scores; and R the coefficient of 
multiple correlation. Substituting we have: 


20 
¢ = ————_—. = 2.1443 
0.4969 X 18.77 
Multiplying the weights in our regression equation by this 
constant value, we convert our regression equation into a 
prediction formula: 


XZ, = 1.4759z2 + 0.148823; + 0.20752, + 0.295325 


Substituting the means of the variables and combining numeri- 
cal values we arrive at the form of our prediction formula which 
is available for immediate use with the raw scores on the tests: 


X, = 1.4759X, + 0.1488X; + 0.2075X, + 0.2953X5 — 113.3278 


Regression equation and prediction formula for criterion and five 
tests 


The working formula for six variables is: 


T : .23468 G1 .23458 T 22456 O: .23486 
T1 = Ti2.3458 —— Sotfuan- 2 + Tis ~4 + '—__ 
O 3.12456 T 4.12356 §-12346 


‘ T: .23456 
Te T Vie.oms ~ Ba) 
OF .1205 








14C, L. Hull, Prediction formulae for teams of aptitude tests. 
Journal of Applied Psychology, September, 1923, pp. 277 to 284. 
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Substituting the proper values we have: 
x, = 0.63332, + 0.12047; + 0.0901z, + 0.10267; + 0.29702, 


The constant term by which these weights must be multi- 
plied to convert the regression equation into a prediction 
formula, as before explained, is: 


20 
es — = 2.049 
0.52 K 18.77 


The correct weights are then: 
2X, = 1.29762. + 0.246773 + 0.184627, + 0.21027; + 0.60842, 


Substituting (X—M) for (x) and combining the non-literal 
values as in the preceding case we have our prediction formula 
for the five tests: 


X, = 1.2976X_+0.2467X; + 0.1846X,+0.2102X, + 0.6086X, — 146.3294 


Now if these weights are correct we should be able to go back 
over the scores of the 210 subjects on the five tests and predict 
scores on the criterion which will correlate with the actual 
scores to the extent of our R which for the criterion and the 
five tests was +0.5200 In order to facilitate these calcula- 
tions, a table was prepared showing all possible products of the 
respective weights by the scores made in each test. 

The coefficient of correlation between the predicted scores 
and the actual scores, as computed by means of our adapted 
products-moment formula, is +0.5098 which is a little short of 
the true figure. This may be the result of slight errors in cal- 
culation, or it may be due simply to the dropping of decimals; 
all decimals were dropped from the predicted scores. The 
mean of the predicted scores is 49.98 as compared with 50 for 
the actual scores, a very close approyimetion. The o for the 
predicted scores is 19.82 as against 20 for the actual scores. 
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PITCH INTENSITY TIME 
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Xs X4 Xs 
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Products of test scores by prediction formula weights 


102 
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TABLE 2—Continued 


SENSE OF SENSE OF i ee! ex 
z » & oa { 4 

PITCH INTENSITY TIME _ i 
¢ Xs Xs 445 Xs 


58.365 9. 456 27.387 

662 | 669 27.996 
60.959 | | 9.1 28.604 
62.256 | 213 


63.553 821 


64.850 | | 30.430 
147 | | 31.039 
444 | 31.647 
741 | 32.256 
038 | | 32.864 
335 | | . | 33.473 
632 | 3: 34.082 

3.929 522 | | 34.690 
5.226 | 1 | 35.299 
523 


820 


“I sJ 
ne © 


~“I 73 *~J 
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oon oor W 














ANDREW THOMAS WEAVER 


TABLE 2—Concluded 





SENSE OF SENSE OF SENSE OF 
PITCH INTENSITY | poo TONAL MEMORY| VOCABULARY 


Xe Xs Xa Xs X: 


103.760 | 19.736 | 14.768 16.816 688 
105.057 | 19.983 14.953 | 17.026 9.297 
106.354 | 20.229 15.137 17.336 9.905 
107.651 20.476 15.322 17.447 514 
108.948 | 20.723 15.506 17.657 122 
110.245 | 20.969 15.691 17.867 51.731 
111.542 | 21.216 15.876 18.077 340 
112.839 | 21.463 16.060 18.287 | 948 
114.136 710 16.245 18.498 3.557 
115.433 956 16.430 18.708 | 54.165 


116.730 | .203 | 16.614 18.918 | 774 
118.027 | 450 16.799 | 19.128 | 383 
119.324 | 696 | 16.983 19.338 | 991 
120.621 | 943 | 17.168 | 19.549 | 600 
121.918 | 190 | 17.352 19.759 208 
123.215 436 | 17.537 19.969 | 817 
124.512 | 683 722 20.179 426 
125.809 | 23.930 906 20.389 9.034 
127.106 24.177 091 20. 600 643 
128.403 24.423 275 20.810 251 
129.700 24.670 8.460 21.020 60 . 860 


Summary and conclusions 


Of what practical value is a battery of aptitude tests corre- 
lating to the extent of +0.52 with a criterion? ‘Those who have 
never attempted to assemble a group of prognostic tests may 
consider a coefficient of +0.52 too small to be worth much. It 
may be asserted that a relationship represented by a coefficient 
of this size means that the predictions issuing from the use 
of the tests will be wrong as frequently as they will be right. 
This attitude rests upon a failure to understand the essential 
nature of correlation. 

There are doubtless present in our computation many fac- 
tors which attenuate our coefficient. At least two such fac- 
tors should be noted. 
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Inaccuracy of the measures 


Although the final score on each test was the average of two 
trials, it was probably still some distance from an accurate 
measure of the subjects’ true ability. One reason for this is 
the inevitable confusion between the physialogical and the 
cognitive thresholds in the Seashore tests.'* It was not unusual 
to find a subject who in one of his records on the pitch test, 
usually the first, distinguished between the two tones in some 
of the columns where the difference was relatively large but 
confused the higher with the lower. Such a subject evidently 
knew that the two pitches differed even though he was mistaken 
as to the direction of the difference. In other words, the 
record showed a poor knowledge of pitch rather than a poor 
sense of pitch. 

If time permitted, all subjects should be given training enough 
to obviate such gross inaccuracies of measurement. There can 
be no question but that they cut down the coefficient of corre- 
lation. On this basis we are justified in maintaining that if 
the measures were accurate we should probably have a higher 
correlation. 

As was stated in the preceding chapter, the formula for the 
conversion of ranks into linear units presupposes a symmetrical, 
bell-shaped distribution. Since, from a careful examination 
of the data, it is doubtful whether the distribution actually 
conforms strictly to this standard, the application of the formula 
probably introduces another factor of attenuation. The one 
comforting aspect of this situation is that the resulting correla- 
tions are less than the true correlations, and that our conclu- 
sions as to the relations between tests and criterion err on the 
side of modesty rather than over-statement. 


Importance of the pitch factor 


ne fact which seems to emerge unambiguously from the mass 
of correlations, intercorrelations partial correlations, and 


14 C, E. Seashore, op. cit., p. 52. 
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multiple correlations is that the sense of pitch is of central] 
importance in auditory experience and in vocal expression, 
Since the test of sense of pitch is correlated with our criterion 
to the extent of +0.4847, and since the addition of four other 
tests raises this figrre by less than 0.04, it becomes apparent 
that sense of pitch somehow is carrying most of the load. 


Sense of pitch and intelligence 


Seashore asserts that sense of pitch does not vary with sex 
and that it is not correlated with intelligence. It may have 
been observed that there was considerable correlation between 
the scores on sense of pitch and vocabulary. While +0.2462 
is not high, it is approximately six times its probable error 
which is only 0.0431 and it therefore seems to be real. Sea- 
shore’s conclusions on this point rests “upon evidence from 
various angles in many thousands of cases.’”’ The one case 
cited is vague, but it rests upon a correlation between teachers’ 
estimates of pupils’ school ability and their scores in sense of 
pitch tests. The statistical method used was a quintile table. 
Even here the results indicated a slight positive relationship 
which Seashore admits. He accounts for this by saying: 
“Some children are so backward mentally that they are not 
able to do credit to their actual psycho-physic capacity.” 
It seems to me that, while this explanation may be correct, it 
would be altogether simpler to conclude that there is some 
correlation. 

I gave the Army Alpha and the Seashore tests to 94 subjects. 
The coefficients of correlation (Spearman’s Rank Method) 
between the scores on the Army tests and the scores on the 
Seashore tests were: 


. Army Alpha and sense of pitch = +0.35 

. Army Alpha and sense of intensity = +0.24 

. Army Alpha and sense of time = +0.12 

. Army Alpha and sense of consonance = +0.06 
. Army Alpha and tonal memory = +0.26 
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Implications for the teaching of vocal expression 


What is there in the data brought forth by these studies that 
may be of practical significance for those whose major interest 
lies in teaching vocal expression? Have we discovered any- 
thing which is immediately and definitely utilitarian and, if so, 
what? 

If we are justified in our tentative analysis of talent for vocal 
expression, then it behooves us to examine carefully the ele- 
ments which we have been testing with a view to ascertaining 
which of them, if any, are susceptible of improvement through 
training. For example, if the sensitiveness of the ear to pitch 
differences is associated with skill in using the voice expressively, 
then we should consider the question of improving and using 
this capacity in the student of vocal expression. 

Seashore, Smith, Buffum, and others agree that the sense of 
pitch cannot be improved by training. Such improvement in 
discrimination as arises from practice is held to be the result of 
bringing the cognitive threshold down toward the physiological 
threshold. In one statement Seashore rather confuses his 


stand by remarking: ‘The training in agreeableness of speech 
may furnish more refinement of the sense of pitch than instruc- 


’ 


tion in the piano does.”” It may be wondered how anything 
can “refine” that which is incapable of modification through 
training. It would seem clear that, whatever the essential 
nature of the improvement, every effort should be made to 
develop the cognitive aspects of the sense of pitch as completely 
as possible; the ultimate aim being to make the cognitive and 
physiological limits of differential audition coincide. To this 
end, the use of the Seashore phonograph tests may be com- 
mended as furnishing a simple and available means for training 
in pitch discrimination. 

In so far as the Terman-Binet-Simon word list is a bona fide 
test of general intelligence, it seems reasonable to conclude that 
as the capacity for the handling of concepts increases, vocal 
expression improves. Certain it is that the commonplace 
maxim of speech teaching, viz., that impression or intellectual 
assimilation must precede expression, finds support in these in- 
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vestigations. It is scarcely possible to place too much emphasis 
upon the necessity for understanding and appreciating the 
meanings of words which are to be uttered in interpretative 
reading. 

Since each of these factors of vocal expression is important, 
individual differences inthem among students become signifi- 
cant. By reference to the scores given in the preceding chap- 
ter, we may gain some appreciation of the spread of distribution 
in these auditory capacities. Seashore says: 


One person may hear a difference of } d.v., less than 3}, of a tone, 
whereas another may not be able to hear any smaller difference than a 
half tone or even more; counting } d.v. as the best and 50 d.v. as the 
poorest case observed, it appears that one may be at least two hundred 
times as keen as another in this capacity. 


The scores made by my 210 subjects in all of the tests indicate 
differences of similar magnitude. 

The tests may perform a valuable service for the teacher of 
vocal expression in suggesting the significant limitations and 
the special capacities among the students. If, for example, a 
teacher gives the students the pitch test and finds that a particu- 


lar individual has a very bad ear for pitch difference, it would 
seem the part of wisdom not to expect such a student to make 
effective use of the pitch element in vocal expression. Probably 
the best procedure would be to train the subject to compensate 
for such deficiency by substituting variety in volume, time and 
quality for pitch changes. 


Future studies 


It should be clear from what has been said thus far that 
experimental studies of vocal expression and associated prob- 
lems are but beginning. If after having gone through the proc- 
ess once, one could recommence such a series of studies as has 
been described, it would be possible to do many things more 
effectively. As an investigator works through one problem, 
new problems and suggested methods of attack loom on every 
hand. If the present studies help to map out some slight 
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portion of terra incognita and to suggest ways by which more 
may be surveyed, they will not have been wholly vain. To 
that end it may be worth while to indicate briefly what now 
appear to be the future studies most likely to bear valuable 
fruit. 


Emotion and vocal expression 


Vocal expression originates as emotional response and emo- 
tion is being looked to more and more for the explanation of 
many of the basic phenomena of voice. The work of Blanton 
and others has proceeded upon the thesis that abnormalities 
in vocal expression are directly traceable to stress, strain, and 
conflict in the emotional life. From time immemorial there 
has been a general agreement among teachers and students of 
vocal expression that the voice is conditioned and controlled by 
emotional states. 


It is not difficult to see how this idea has acquired its popu- 
larity. What we need at this point is some more generally 
accepted definition of emotion and more accurate ways of 
getting objective measures of emotional states and phenomena, 


particularly of emotional sensitivity and control. We should 
seek to measure the sensitiveness to emotional stimuli first of 
all. But more important than this must be the type of emo- 
tional response. It would seem more than probable that unless 
a reader is responsive to emotional values and suggestions, he 
is bound to be cold and inexpressive vocally. And yet it is 
quite conceivable that he may be too sensitive or at least too 
uncontrolled in his response. 

The plethysmograph, the pneumograph, the cardiograph, 
the psycho-galvanic reflex, the verbal report, blood tests, etc., 
suggest themselves as possible methods of approach. We need 
objective measures of emotional responses and these objective 
measures must be carefully studied with reference to the psycho- 
logical states with which they are correlated. Then the capac- 
ity for vocal expression must be measured in some way and the 
relation between this criterion and the phenomena of emotional 
response carefully considered. 
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Neuro-muscular coérdination and voice 


Voice is produced by the same sort of mechanism as is mani- 
fested in walking, breathing, handwriting, etc., viz., by the 
contraction and relaxation of muscles. Numerous muscles 
must work together properly to make articulate vocalization 
possible. It then appears obvious that skill and effectiveness 
in the codrdinated use of these muscles determines vocal 
expressiveness. Here is a rich and exceedingly promising 
field for investigation and, moreover, one which lends itself 
readily to experimental methods. Here are involved the fol- 
lowing factors of voice control, according to Scripture’s analysis 
already cited: reflex tonus, force of movement, accuracy of 
movement, precision of movement, accuracy of codrdination, 
quickness of response, and general voluntary control. We are 
indebted to Scripture for suggestions as to how some of these 
various factors may be measured. He proposes that we study 
muscle tonus with a tonal dynamometer. He also explains 
methods of measuring force of movement in the respiratory 
muscles and in muscles of the lips and tongue. 

Scripture holds that vocal control is dependent upon general 
voluntary control and that studies of arm and finger movement 
furnish results which are directly applicable to the problem of 
voice control. If we accept this point of view, we may go 
forward with some of the recognized methods for the study of 
reaction, time, speed of movement, accuracy of movement, 
etc. By applying the technique of correlation to our results 
we may be able to interpret them in terms of their relation to a 
criterion adequately representing vocal expression. 
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Among the factors that determine the affective value of 
any visual presentation (such as color, subject, balance, light 
and shade), line forms have occupied an important position in 
the opinions of writers on Aesthetics. Cox! says: 


Straight lines will always express rigidity and stiffness while curves 
will express some sort of growth or motion. The vertical line is a line of 
stability, of strength and vigor. . . . All these characteristics of 
lines may be the result of association or they may have some deeper 
reason, but they are there, in the lines themselves, without regard to 
what the lines may be used to represent, and are the most valuable means 
to artistic expression. 


According to Puffer’? 


The moment we touch upon line form, we are already, in strictness, 
beyond the elements. For with form enters the motor factor, which 
cannot be separated from the motor innervations of the whole body. 

It is possible, however, to abstract for the moment, from the form as a 
unit, and to consider here only what may be called the quality of a line. 

A line may be straight dr broken, and if curved, curved continuously 
or brokenly, ete. That this quality of a line is distinct from the form 
may be shown by the simple experiment of turning a spiral in different 
ways around its focus. The aesthetic effect of the figure is absolutely 
different in the different positions, and yet the feeling about the charac- 
ter of the line itself seems to remain the same. 

The very process of apprehending a line involves not only motor 
memories and impulses, but numberless ideal associations, and these 
associations constitute the line as truly as do the others. The impres- 
sion of the line involves expressifp, a meaning which we cannot escape. 





1 Concerning painting, pp. 44ff. a 
? Ethel D. Puffer, Psychology of beauty, p. 102, 116. 
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Miinsterberg® interprets the effects of lines as follows: 


Every curve or line or space division is thus psychologically a system 
of eye movement sensations. The optical impression, as it is at present 
and for itself alone, may absorb our mind; then the motor impulse to the 
organism will discharge itself and lead to localized tensions and move- 
ment sensations. 

The result must be that the feelings of strain and impulse that go on in 
ourselves are not projected into our body, but into the visual impres- 
sions; just as the optical sensations were all the time joining themselves 
with the movement sensations of the eye muscles, so in this case optical 
sensations and eye muscle sensations are fusing with sensations of bodily 
tension, and while the muscle sensations of the eyes give the local values 
and distance relations to the light impressions and thus build up ideas 
of geometrical forms, these sensations of impulse and strain give to the 
optical form an element of force and energy. 

We are contracting our muscles, but we feel as if the lines were pull- 
ing and piercing, bending and lifting, pressing down and pushing up; in 
short, as soon as the visual impression is really isolated and all other 
ideas really excluded, then the motor impulses do not awake actions 
which are actions of ourselves, but feelings of energy which are taken as 
energies of the visual forms and lines. 


Holliagworth,‘ in discussing the feeling tone of advertise- 
ments, says: 


This feeling tone of lines can be used to advantage in representing 
advertised articles both by relevant and irrelevant cuts, and should 
also be considered in the appropriate selection of type faces. The 
feeling tone of a line depends upon three chief factors; its quality; its 
direction; and its character, as straight or curved. 


Lundholm® reports an experimental study of the feeling 
value of lines. The problem is indicated in the following 
statement: 


Literature about art very often gives us descriptions of masterpieces 
wherein pure lines are characterized by adjectives that indicate a more 
or less emotional quality. Thus authors used to write about melancholy 
lines in the paintings of Perugino, quiet lines in certain classical schools, 





’ Hugo Miinsterberg, Principles of art education, p. 82ff. 

4H. L. Hollingworth, Advertising and selling, p. 142. 

‘The affective tone of lines: Experimental researches. Psychol. 
Rev., 1921, vol. 28, p. 43-60. 
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violent lines in the baroque art, etc. Out of these facts there arises a 
problem. Is the effective character of a line a quality which is bound to 
the line itself, or is it suggested by the literary subject of the master- 
piece? Furthermore, is this quality a omenon that appears equally 
to different observers? 


Lundholm presented to a group of eight subjects a series of 
forty-eight adjectives, which could be grouped into thirteen 
classes, all the terms in a class being synonyms. Each subject 


was instructed to draw upon a sheet of white paper 21 by 27 
centimeters a line which should express the affective tone of 
one of the adjectives. Subjects were allowed complete free- 
dom in these reactions with this exception: They “were re- 
quested to express the adjectives as far as possible by pure 
line, not to symbolize sadness by the curve of a melancholy 
mouth or strength by a line suggesting the contour of a rock 
formation, etc.” 

When the lines thus produced were studied there were found 
to be striking uniformities among the subjects in their reactions 
to the various adjectives, in the use of curves and angles, slow 
and fast rhythm and direction of lines. The following con- 
densed table (table 1) showing the reactions of the subjects to 
the thirteen classes® of adjectives is adapted from Lundholm. 
The names at the top of the table indicate the nature of the 
line, e.g., curves: big, medium and small; and direction 
horizontal, up and down. The letters refer to the lines in 
Figure 1,7 where the character of the various lines is illustrated. 
The numbers in the body of the table represent, in terms of 
per cent, the lines of a given type that were drawn to express 
each of the thirteen classes of feeling. 

Inspection of this table reveals a high degree of agreement 
in most cases. For example, a big curve (like A, B or C)? 
expresses “sad” in 82 per cent of the cases, “quiet” in 100 per 
cent of the cases, and “lazy” in 92 per cent of the cases. On 


* In the table each class is represented by only one adjective. The 
complete list will be given later (see page 193). 

’ Figure 1 is not taken from Lundholm but forms a part of the writers’ 
experiment and will be described later. 
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the contrary a line with small angles expresses “hardness’’ in 
46 per cent of the cases. Inspection of the last three columns 
of table 1 shows the importance of the direction of lines. A line 
moving downward (like or I) expresses “‘sad’”’ in 84 per 
cent of the cases, while a line ring upward (like B, E or H) 
expresses “‘merry”’ in 58 per cent of the cases. 

The following passages sum up Lundholm’s findings: 


TABLE 1 
Feelings and the lines that represent them 
(Adapted from Lundholm) 





CURVES | ANGLES DIRECTION 


] 
Medi-| « } : Medi-| 
aie Small Big i | meet Hori-| 
SR lzontal 


ABC | DEF | GHI | JKL | MNO | | Fa | 








. Agitating.......| 2.0) 2.0) 7.0) 
. Furious......... | 2.5) 





13.0, 26.0 
41.0) 6.0) 25.0) 
| 75.0, 6.0) 13.0) | 25. 

| 4.0 | 4.0) 25.0) 46.0| 54.0) 17.0) 21.0 

. Serious... ... ++| €8.0 19.0} 3.0) 38.0) 18.0) 44.0 
. Powerful 25.0, 38.0, 4.0) 4.0) 21.0) 4.0) 37.0) 50.0) 13.0 


i. 
2. 
3. 
4. 
5 

6 

t. 
8. 
9. 








Lines symbolizing states of strong motor expression have short waves 
and acute angles and lines symbolizing states of weak motor expression 
have long and low waves; and second, that lines with waves of the 
former type and acute angles themselves suggest intense motion, while 
lines with waves of the latter type suggest weak and slow motion. This 
justifies us in supposing that the effective character of lines has its origin 
in the suggestion of movement of the line, that it depends upon the idea 
that this movement in some way imitates the motor expression of an 
emotion. This supposition becomes greatly strengthened by the fact 
that the subjects themselves have mentioned the movement as being of 
importance for the emotional expression of the lines. 
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Concerning direction of lines: 


The downward tendency of a line expresses relaxation, the upward 
expresses power. The downward tendency expresses faintness, not 
sufficient strength to keep up. Going downwards expresses losing of 
energy. The doleful line droops without energy, If it had force it 
would have ascended higher. Strength is expressed by going upwards. 
A joyous line also ascends, Joy is an uplifting feeling. A forceful line 
tends upwards. Thereby it obtains the idea of ambition. A line indi- 
cating strength is a line tending upwards, never downwards. 

Therefore, it seems to be obvious that even the direction of the lines 
to a certain extent imitates the motor expression of an emotional state 
and that consequently the direction is one of the factors that partakes 
in giving them their affective tone. Direction upwards expresses 
strength, energy, force, ambition, uplifting feelings, etc., direction 
downwards, weakness, lack of energy, relaxation, depression, etc. 


In the experiment of Lundholm, then, the subjects drew 
lines which represented their feelings. The subjects were neces- 
sarily few on account of the labor of classifying and analyzing 
the lines drawn. Special interest was directed to an explana- 
tion of the feelings associated with lines. In the experiment to 
be reported in this paper the primary interest was the discovery 
of the feelings that are aroused in looking at lines of various 


kinds, rather than in drawing them. We were interested in 
the influence of lines in determining the affective reaction to a 
work of art, a piece of architecture, or an advertisement. Ifa 
motor reaction occurs here, it is limited to eye movements and 
to incipient rather than overt muscular responses of other 
mechanisms. 

The material for this experiment consisted of the following: 

1. A set of eighteen lines, representing the simple classes of 
lines arfd their directions discovered by Lundholm in his analy- 
sis of his subjects’ reactions. These were prepared in the form 
of white lines on a blue background (blueprints) 84 by 11 inches 
in size, arranged in the order shown in figure 1. Each line 
could be identified by means of a letter printed just above it. 

2. A sheet containing forty-seven adjectives arranged into 
thirteen classes. These classes were the same as used by Lund- 
holm except that the adjective “sprightly” was omitted from 
class 5, and that the adjective “harsh” was put first in class 11. 
The first word in each class was underlined. 
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Fig. 1 


At the top of the sheet was a set of simple instructions. 
This sheet is reproduced below. The task to be performed was 
very simple. Each subject, with the lines before him, began 
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with class 1 of the adjectives and sought among the eighteen 
lines that one which best expressed the feelings indicated in 
class 1. The letter designating the line thus chosen was 
written at the left of the sheet opposite class 1. Then a line 
was sought for class 2, and so on until the most appropriate 
line was indicated for each of the thirteen classes. As stated 
in the instructions the same line could be used to indicate as 
many feelings as the subject wished. 

Five hundred subjects gave their reactions in the course of 
the experiment. These were originally treated separately in 
groups ranging in size from 8 to 60, but the differences among 
groups were too slight to warrant reporting. The group of 
five hundred taken as a whole probably represents a fair 
sampling of educated people. 


Below you will find thirteen sets of words, each set indicating a 
particular feeling state or emotional state. The first word in each set 
will serve as a cue to the others. 

On the accompanying chart you will find a series of lines, eighteen in 
number, each designated by a letter. 

Begin with class 1 of the feelings and find that line on the chart that 
best expresses to you the feelings that class 1 represents. Mark the 
letter attached to this line in front of class 1 (under ‘‘Letter’’). Do the 
same with class 2 of the feelings, and so on until each of the thirteen 
classes of feelings has been given a letter. You may use the same line 
as often as you wish. 

LETTER 
1. Sad, melancholy, mournful, doleful, sorrowful 
2. Quiet, calm, trartquil, serene 
3. Lazy, indolent, idle 
. Merry, cheerful, gay, jolly, joyous 
5. Agitating, exciting, fiery, brisk, vivacious, lively 
. Furious, angry, cross, vexed, enraged 
. Dead, dull 
. Playful 


. Weak, feeble, faint, delicate 
: Gentle, mild 
- Harsh, hard, cruel 


. Serious, solemn, grave, earnest 
3. Powerful, forceful, strong 


The lines chosen by the five hundred subjects to represent 
each of the thirteen classes of feelings may be seen in table 2. 
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The class is indicated at the left of the table by the number and 
the first adjective in the class (see Record Sheet above). The 
various lines are indicated at the top of the table by the descrip- 
tive terms—curves:* big, medium, small: angles: big, medium, 
small—and also by the letters which refer to figure 1. The 
numbers in the body of the table give the per’ cent of the sub- 
TABLE 3 
The se of form and rhythm and direction 
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jects choosing any given line. Thus, for “sad” 8.3 per cent of 
the five hundred judges chose line A which is a big curve in the 
horizontal position; 65 per cent chose C which is a big curve in 
the descending position; 1.8 per cent chose J which is a big 
angle in the horizontal position; and 2 per cent chose R which is 
a small angle in the descending position. 

From this detailed table others may be compiled to show the 
influence of various characteristics of the lines. Thus, table 
3 combines the percentages for a given shape of line regardless 

* In this report the curved or angular character of the line will be 


called its ‘‘form,’’ the size of the waves or angles will be called ‘‘rhythm”’ 
and the direction will be referred to simply as ‘‘direction.”’ 
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of its direction and for a given direction regardless of shape. 
In this table it appears that “‘sad”’ is represented as a big curve 
by 76.3 per cent of the subjects (the sum of A, B and C in 
table 2); as a medium curve by 5.5 per cent; and as a small curve 
by 4.5 percent. It is represented by a descending or ““downward”’ 
line in 84.3 per cent of the subjects. The figures in table 3 may 
be compared directly with those in table 1 which contains 
Lundholm’s datay It should be remembered that the most 
striking difference in the methods of obtaining these data is 
that Lundholm’s subjects drew lines to represent feelings 
while our subjects chose from a set of 18 lines certain ones which 
represented their feelings. 

In table 4 a rough comparison is made between these two 
sets of data. The feeling classes are arranged, according to 
the amount of agreement, into three groups called “agreement,” 
“agreement moderate” and “‘disagreement.”’ The “agreement” 
group may be further divided into two subgroups, namely, the 
first three where agreement is very close, and the second three 
where there is a shift of emphasis between medium and fast 
rhythm. The second group contains cases in which an addi- 
tional type of line appears in either set of data, but in which 
there is no shift from curves to angles or vice versa. The 
third group, “disagreement,’’ contains cases where there is a 
shift from curves to angles (or vice versa) or a considerable 
discrepancy within the curve or angle group (as in 13—power- 
ful). 

In the “‘disagreement”’ group, class 7 (dead) does not repre- 
sent any serious disagreement since the shift is from big 
curves to big angles; that is, it seems to be the same slow rhythm 
of movement that is important in expressing “sad.’’ In the 
case of class 9 (weak) there are big curves and small curves in 
both sets of data. The additional type of line is the big angle. 
The other discrepancies are due, probably, to differences in 
interpretation of the adjectives. This is especially true in the 
case of ‘“‘serious,’”’ as shown by introspective reports of the sub- 
jects. Lundholm with eight selected subjects could be sure of 
greater uniformity in interpretation than could be attained 
with five hundred subjects who followed printed directions. 





3. Powerful......... 


TABLE 4 
Comparison of the two experiments 


LUNDHOLM POFFENBERGER AND BARROWS 


Agreement 


Big curves (82.0) Big curves (76.3) 
Big curves (100.0) | Big curves (83.3) 
Big curves (92.0) Big curves (50.4) 


Small curves (50.0) Medium curves (46.1) 
Medium curves (18.0) | Small curves (25.2) 


8 Plavful.........../| Small curves (26.0) Medium curves (42.5) 
Medium curves (13.0) | Small curves (28.7) 


iets. oe so f Small angles (46.0) Medium angles (58.4) 
Medium angles (25.0) | Small angles (23.5) 


Agreement—moderate 


5. Agitating Small angles (14.0) Small angles (45.0) 
Medium angles (33.5) 


ee Small angles (21.0) Small angles (42.0) 
Medium angles (39.6) 


. Gentle 3ig curves (75.0) Big curves (43.8) 
| Small (24.4) 
Medium (21.4) 


Disagreement 


Big curves (69.0) | Big angles (28.4) 
Big curves (28.0) 
Big curves (41.0) | Small curves (28.4) 


Small curves (25.0) | Big curves (28.2) 
Big angles (25.4) 


Medium angles (19.7) 
Big curves (16.8) 


Big curves (25.0) 
| Medium curves (38.0) 
| Medium angles (21.0) 


Medium angles (49.0) 
Big angles (18.4) 
Small angles (17.7) 


| 
fo | Big curves (69.0) | Big angles (33.7) 
| 
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Certainly this comparison shows the agreements to be more 
striking than the disagreements. The question arises as to 
whether the disagreements that do occur are such as one would 
expect to find if they were due to the one differing factor in 
the experiments, namely, that in one case lines were drawn and 
in the other they were looked at. Lundholm speaks of two 
-types of adjectives, those carrying “strong motor expression” 


and those carrying “small motor expression.’’ In the latter 
group are classes 1, 2 and 3, and in the former are classes 4, 5 
and 6. It is in the cases of classes 1, 2 and 3 that the closest 
agreement is found between the two sets of data, that is, where 
motor expression is weak. Thus, one might conclude that the 
two experiments, one involving motor expression in the form 
of line drawing movements and the other involving no such 
motor expression agree best in the case of those feelings whose 
motor expression is weakest (or where the distinction between 
the two experiments is at its minimum). However, in the case 
of classes 7, 9 and 10 where there would seem to be ‘smal! 
motor expression” the agreement between the two experiments 
is not so close. Still, it must be remembered that even if the 
motor factor is the important factor in the feeling tone of lines, 
eye movements and implicit movements of other mechanisms 
may be good substitutes for the actual line drawing movements, 
or may even be more important than these. 

The nature of the agreements and disagreements revealed 
by this comparison suggests that it is important to discover 
what characteristics of the lines, namely, curves or angles, 
rhythm or direction have the most weight in determining the 
feeling reactions. An attempt will be made to interpret the 
data in this fashion in the course of our report. 

Let us first compare the direction factor in the two sets of 
data. Table 1 contains these figures for the Lundholm experi- 
ment, and table 3 contains the same for our experiment. ‘The 
comparison is presented in table 5. As in table 4 we can make 
three groupings, ‘‘agreement,”’ “agreement moderate’ and 
“disagreement.”’ The amount of agreement is determined 
simply by inspection, as the material does not warrant a more 
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TABLE 5 
The influence of direction 


LUNDHOLM 
Agreement 


POFF ENBERGER AND 
BARROWS 





| Down (84.0) 
Horizontal (81.0) 


| Down (63.0) 
| Horizontal (29.0) 


4, Merry..................4| Up (68.0) 
Horizontal (40.0) 


0 ikincensdctvonccs | Up (50.0) 
| Horizontal (38.0) 


Down (47.0) 
| Horizontal (44.0) 





10. Gentle | Horizontal (75.0) 


| 


13. Powerful }| Up (50.0) 


Horizontal (37.0) | 


| Down (84.3) 


Horizontal (90.2) 


Down (51.5) 
Horizontal (38.7) 


Up (79.5) 
Horizontal (16.4) 


Up (65.0) 
Horizontal (28.2) 


Down (60.0) 
Horizontal (31.6) 


Horizontal (73.7) 


Up (55.5) 
Horizontal (37.9) 





Agreement—moderate 





CVG Agitationg... ......ccccced {| Horizontal (52.0) 
\ Up (41.0) 

1. Dead........+.+.++++++,f{ Horizontal (75.0) | 

‘\} Down (25.0) | 





Up (68.8) 
Horizontal (23.1) 


Down (50.4) 
Horizontal (46.6) 





Disagreement 





Horizontal (44.0) 


Down (13.0) 


7 
6. Furious | Up (38.0) | Down (20.7) 
| 


| Horizontal (54.0) 
Lh, Es inkwieeinnscnt | Down (21.0) 
| Up (17.0) 


a Down (44.0) 
12. Serious. | Horizontal (38.0) 
\| Up (18.0) 
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Up (62.8) 
Horizontal (16.4) 
Horizontal (40.1) 


Up (30.6) 
Down (29.3) 


| Horizontal (64.4) 


Up (19.1) 


| Down (16.2) 
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refined method. Here again the resemblances between the 
two sets of data are more striking than the differences. The 
same relationship between weak motor expression and agree- 
ment between the two sets of data and strong motor expression 


and disagreement holds as appeared in table 4. 

The remainder of the report will be concerned with an analy- 
sis of our own data from the five hundred subjects. 
preceding comparison of the two sets of data raises two ques- 


tions: (1) What are the essential characteristics of lines repre- 
senting the different classes of feelings? and (2) what is the 
relative importance of these different characteristics? The 
first of these questions may be answered by reference to table 6. 
Here we find in what per cent of the cases a curve was chosen to 
represent a class of feelings; in what percent of the cases an 
angle was chosen; also what rhythm and what direction of line 
expressed the feeling best. The figures are obtained by totalling 
the percents shown in table 2. Thus “‘sad”’ was represented by 
some kind of curve in 86.3 per cent of the cases (Tabie 2, 
A, B, C, D, E, F, G, H, I,); and by some kind of angle in 14.3 
per cent of the cases (table 2, J, K, L, M, N, O, P, Q, R,). 
“‘Sad”’ was also represented by a slow rhythm in 86.8 per cent 
of the cases (table 2, A, B, C, J, K, L); and by a line in the down- 
ward direction in 84.3 per cent of the cases (table 2, C, F, I, 
L, O, R). 

The brief statement in the last column expresses the domi- 
nant character of the line representing any of the 13 classes of 
feelings. Note that the cases of the slow, descending curve are 
“sad” “lazy”, and “weak;”’ the cases of the slow horizontal 
curve are “quiet” and “gentle.” The medium rising curve 
represents “merry” and “‘playful.”’ The rapid or medium ris- 
ing angle represents ‘‘agitating,”’ “furious” and “powerful.” 

The figures in table 6 do not, however, enable us to answer 
the second question which concerns the relative importance of 
the various characteristics of the lines. The total per cents 
represent the combination of different numbers of lines, (e.g., 
the curve includes nine lines and the rhythm includes 6 lines). 
If we find the average per cent per line by dividing by the 
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number of lines added to get a given total, we will have all 
figures on a comparable basis. Then the largest figure will 
represent the characteristic of the line which in a given case 
has the greatest influence. Table 7 presents the figures reduced 
to such a comparable basis. The classes are grouped into pairs 
of opposites for easy comparison. The three classes which 
do not permit of this grouping, namely, “lazy,” “furious” and 
“dead”’ are placed at the bottom of the table. 


TABLE 7 


Relative value of different line characters 


DIRECTION RHYTHM | FORM 


| Hori-| \atedi-| oo , | 
Let Up Down| Slow | oy | Fast | Curve Angle 


| 9. 57/89 


ee! 
. Playful 


2. Quiet 
. Agitating 


. Gentle 


POMS Sacccmanee 
. Furious 7 \10. 
- Dead.................| 8 | 0.4} 8.4 11. ; | 3. | 5. 








By reading across the table and finding the largest figure we 
see that in the case of “sad,” direction and rhythm of line are 
equally important while form is less important; in the case of 
“merry” direction is most important while rhythm and form 
are less important; in the case of “harsh,” rhythm and form are 
equally important and more so than direction; in the case of 
“furious,” direction and form are most important, and rhythm 
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least important; in the case of ‘‘dead,”’ rhythm is most impor- 
tant, direction next and form least important. Now, if we add 
together the largest scores for direction, for rhythm and for 
form respectively we get the following totals, 141.1, 132.0 and 
115.0 from which we may conclude that in expressing the feel- , 
ings included in this study, direction of line is generally most 
important, rhythm next and form least_important. 

‘ The same table with its groupings into contrasting feelings 
shows the relationship between lines representing contrasting 
feelings in respect to direction, rhythm and form. The larger 
the number in this table, the greater is the effect of the factor 
which it represents. 

Our experiment offers little in the way of an explanation of 
the feeling reactions described. A typical introspective report 
showed the relation between the reactions to the lines and cer- 
tain popular expressions, as for instance, ‘‘down in the dumps,” 
“up in the air,” “‘sharp tongue,” “rollicking time.”’ Such ideas 
came to mind in reacting to “sad,” “merry,” “playful,” ete. 
Again, there was the association of the idea of the normal with 
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a horizontal line and the departures from the normal or hori- 
zontal became indicative of “‘harshness,”’ “furious,” “agitating,” 
etc. Such reports are of little use in determining the real 
basis of the feeling reactions. It may be that the reactions to 
the lines are due to these simple associations or that the associa- 
tions themselves are due originally to the immediate responses 
to the lines. The predominance of certain lines for expressing 
certain feelings in a group of subjects of this size might suggest 
that the feeling reactions are immediate and fundamental 
responses. Another type of introspective report showed a 
kind of emotional warmth or glow aroused by curves, especially 
the larger curves, while the sharp angles gave a feeling of rough- 
ness or conflict that could not be further analyzed. For a 
discussion of the analysis of the feeling reactions to lines the 
reader is referred to the article by Lundholm. 

If the feelings are to be played upon by means of lines in 
practical life, it makes little difference whether the particular 
feelings aroused by a line are immediate or the result of associa- 
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tion, except in regard to their universality and their stability. 
These are matters that could be measured by getting a wider 
range of subjects and repeating the tests over a long period of 
time. The results obtained from this study have some bearing 
upon those forms of art that are created to influence people’s 
reactions. Thus in advertising the aim is to influence the 
market for some commodity and no labor or expense is spared 
to create a pleasing and appropriate atmosphere. Along with 
appropriate colors and color combinations, appropriate type 
faces, appropriate balance of light and shade, appropriate line 
characters may take their place as factors creating favorable 
responses. Figure 2 shows a series of border designs that form 
the common stock of the advertiser and the printer. These 
vary strikingly in rhythm and quality. As far as the writers 
know, border designs in advertising are prepared merely for 
their general esthetic effect and for the purpose of novelty. 
They might be more effectually used by taking account of the 
relation between quality, direction and rhythm of line and the 
feelings that are aroused in seeing them. 





AN EVALUATION OF SOME INFORMATION 
QUESTIONS 
WILLIAM R. WILSON, GERTRUDE WELSH ann HAROLD 
GULLIKSEN 


University of Washington 


One of the inescapable annoyances of the maker of mental 
tests is the individual who claims that certain performances 
required by the tests are “obviously’”’ not related to general 
mental ability. There are few testers who have not suffered 
from the insistence that there is no relation between the ability 
to discriminate between synonyms and antonyms and intelli- 
gence or that “it stands for reason” that school grades in arith- 
metic are better measures of intelligence than a test of general 
information. The natural impatience of the psychologist with 
this point of view is somewhat restrained by the memory that 
he himself has only very recently given up the compilation of 
mental tests out of elements which his “common sense’’ told 
him were good measures of mental ability. The random, 
empirical, search for significant test performances is, in fact, 
so recent that the majority of testers can still remember when 
the acceptance of this new method seemed thé rejection of 
reason in favor of a blind groping. The ‘common sense” 
method of selecting test elements is by no means extinct 
in the finer details of test compilation. The present paper 
reports a small extension of the empirical method that has 
proven itself of value in selecting information questions as com- 
ponents of mental test batteries. 

Three years ago in attempting to evaluate the various parts 
of the Army Alpha test it became quite apparent that nearly 
one third of the information questions contributed nothing 
significant to the final score and that a few questions were 
answered correctly more often by dull students than by bright. 
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It was quite impossible to tell with any accuracy by inspection 
alone the value of a question as a measure of intelligence. The 
writer does not know in what way the information test ques- 
tions of the most recent batteries of tests have been selected, 
but with many of the standard tests the judgment of the com- 
piler was entrusted with this rather difficult task. The assump- 
tion has often been implicit that while any particular question 
may be worthless the score obtained by application of all the 
questions will have value. It speaks well for the judgment of 
the inventors of our tests that their information questions are a 
valuable part of the battery. It is possible, however, by an 
extension of the empirical method to increase very greatly the 
validity and reliability of information questions. 

In the preparation of a mental test to be given to freshmen 
of the University of Washington in the fall of 1921 the informa- 
tion test elements were selected from an original list of four 
hundred questions. A tentative trial of these questions showed 
that for various reasons many were unsuitable and the number 
was finally reduced to two hundred thirty. These two 
hundred thirty questions were drawn from various sources. 
Sixty were adapted from Whipple’s test of general information. 
Some forty were selected from Alpha forms. The remaining 
questions were largely original. The two hundred thirty ques- 
tions in mimeographed form were given to 400 freshmen mem- 
bers of a class in general psychology. Not more than fifty 
questions were given in any single day and the students were 
requested to answer every question to the best of their ability 
even though the answer required guessing. 

Three weeks before the information questions were answered 
the class had been given an examination of general mental 
ability of the “cycle” type. This examination which required 
thirty minutes of uninterrupted work contained eight conven- 
tional types of test adjusted to the mental level of college 
freshmen. It has somewhat greater validity and reliability 
than the Army Alpha with which it correlates, in the case of 
college freshmen, 0.78. The 320 members of the class who had 
answered all the information questions and had also taken the 





208 W. R. WILSON, G. WELSH AND H. GULLIKSEN 


mental test were divided into quartiles on the basis of mental 
test score. ‘The per cent of each quartile answering each infor- 
mation question correctly was then determined. 

The discriminative value of the separate questions can be 
shown in various ways. If it is desired to obtain a set of ques- 
tions which will show a high correlation with a test of intelli- 
gence a good measure of the value of a question is the cumulative 
total of the difference in per cent of students in the various quar- 
tiles answering it correctly. After a number of trials it was 
decided to give to each question a numerical value which was the 
difference in per cent of students in the first and fourth quartiles 
answering the questions correctly plus the difference in per cent 
of students in the second and third quartiles answering the 
questions correctly. Thus a question answered correctly by 20, 
35, 45, and 65 per cent of the respective quartiles would have a 
value of 45 plus 10 equals 55. If the purpose of the test is to 
set off sharply those of inferior intelligence, those questions will 
be selected which show a large step between the lowest and the 
next quartile, decile, or other unit. Questions dividing the 
group in any other way desired can be similarly selected. This 
is the method used by the perfectors of trade tests. 

In table 1 are shown the fifty best questions of the two hun- 
dred thirty evaluated. In table 2 is shown the per cent of each 
quartile answering each question correctly (when } has been 
deducted for chance successes) and the difficulty in terms of 
8.D. with the range of ability assumed to be 2.65.D. The 
column headed “value” shows the sum of the differences 
between quartiles by the method already described. 

With the results of an actual try-out before one it is often 
easy to see why a question has no value as a measure of intelli- 
gence. Many questions are so easy that even the least intelli- 
gent answer them correctly and thus the group is not distrib- 
uted. A typical question of this group is, “The watt is a 
measure of HEAT SOUND ELECTRICITY HUMIDITY.” Ninety- 
eight per cent of the highest quartile and 92 per cent of the 
lowest answered it correctly. One of the truisms of testing is 
that questions should not be too easy. Who, however, would 





EVALUATION OF SOME INFORMATION QUESTIONS 


TABLE 1 


ntal , “a 
for- T he forty best questions 


1. Samuel Clemens was a CRITIC HUMORIST ARTIST STATESMAN 

1 be ’ 9. “The Makings of a Nation’’ is an advertisement of a TOBACCO 

ues- FLOUR BAKING POWDER HEALTH FOOD 

elli- 3. J “Bohemian” is DISHONEST UNCONVENTIONAL EARNEST 

a MUSICAL 

tive 4. “The Autocrat of the Breakfast Table’’ was written by HoLMEs 

uar- POE IRVING LONGFELLOW 

was 5. Delphi is known for its WELLS TEMPLES ORACLE VASES 

‘the . Romulus was a mythical king of PERSIA GREECE ASSYRIA ROME 

tiles . The term gambit is used in CHESS TANNING PUTTEES HUMOR 
Saturn was a god of the EGYPTIANS KELTS ROMANS GREEKS 

pent \{ midiron is used in HOCKEY GOLF CRICKET WAR 

the . “Paul Revere’s Ride’ was written by EMERSON BRYANT LONG- 

20, FELLOW HOLMES 

vea 1. An ideally perfect commonwealth is called a REPUBLIC UTOPIA 


Ss to MONARCHY COMMUNE 


ill Walt Whitman wrote MUSIC DRAMA ART CRITICISM FREE VERSE 
wi 


The formula for common salt is NaCl H.SO, H.O MnO, 

the The blowing up of the Maine occurred in 1900 1889 1898 1897 

the 15. Bancroft was a PORT HISTORIAN DRAMATIST LECTURER 

Chis . Among the amphibians are SNAKES FROGS FISHES MAMMALS 

John Wesley was most famous in LITERATURE SCIENCE WAR 
POLITICS 

—_ An entree may be a ROAST DESSERT BEVERAGE APERTURE 

ach 9. The author of ‘“‘The Scarlet Letter’? is HAWTHORNE POE STEVEN- 

een SON KIPLING 

s of Aniline Dyes are obtained from FLOWERS INSECTS COAL TAR 

The SEAWEEDS 

Alexander the Great was a ruler in FRANCE ROME GREECE 
DENMARK 


1ces 


The Bastile was in LONDON PARIS ROME VIENNA 
ften 23. Puer means BOY SHAME CLEAR LOVELINESS 
elli- 24. A substance that is not ordinarily a gas is NITROGEN CHLORINE 
elli- CARBON HYDROGEN 


The chameleon is a BIRD REPTILE INSECT FISH 
Tib- Eugene Field is noted for his CHILDREN’S POEMS ESSAYS SONGS 
IS a RIDDLES 
ety- 27. Amy Lowell is best known as an ACTRESS PAINTER SOCIAL WORKER 
the POET 
g t. . Millet is famous in PHILOSOPHY MUSIC ART LITERATURE 

Pasteur discovered a process of PRINTING STERILIZATION BLAST- 
yuld ING MINING 
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TABLE 1—Continued, 


Papyrus was used for SMOKING WRITING EATING FUEL 
. Braillé refers to accOUSTICS RAISED WRITING WEAVING CALCULTS 
Malthus’ Law concerns POPULATION COINAGE TARIFF SHIPPING 


33. The Corona is a kind of PHONOGRAPH MULTIGRAPH ADDING 


MACHINE TYPEWRITER 
. The agora was & MARKET PLACE SIREN BUILDING FABLE 


35. Atilla was FRENCH AFRICAN HUN ENGLISH 


. Darwin was most famous in LITERATURE SCIENCE WAR POLITICS 
Falstaff appears in ROMOLA VANITY FAIR OLIVER TWIST HENRY Ivy 
Juccaneers were PIRATES EXPLORERS SPIES DIPLOMATS 


9. An epigram is usually TEDIOUS INVOLVED BRIEF AMBIGUOUS 


. Addison was a DRAMATIST POET ESSAYIST NOVELIST 


wm CO bo 


5. 
6. 
 & 


—_ 
-—- Oo Oo © 


19. 


20. 


21 


22. 


23 
24 
25 





TABLE II. 





Twenty-five typical poor questions 

. The original free verse writer was MAX EASTMAN H. L. MENCKEN 
AMY LOWELL WALT WHITMAN 

The messenger of the gods was VULCAN HERMES PAN DIONYSUS 

Portugal is a MONARCHY REPUBLIC DEMOCRACY OLIGARCHY 

Rococo means COBBLED SIMPLE TRIPPING FLORID 

The hemiptera are WORMS INSECTS BIRDS FISHES 

Glycogen is stored in the HEART LUNGS THYROID LIVER 

Chlorine is an OBLONG MANTLE DYE ELEMENT ANESTHETIC 

Amphioxos is 8 LANCELET FROG ANNULATE MAMMAL 

The Suez Canal was built by FRANCE SPAIN GERMANY ENGLAND 

The howitzer is a kind of MACHINE-GUN RIFLE CANNON PISTOL 

1827 is the date of the first TELEPHONE STEAMBOAT RAILROAD 
CANAL 

“The Gold Bug”’ is an IpYL EPIC LYRIC SHORT STORY 

Ohm’s law is used in HEAT ELECTRICITY LIGHT SOUND 

Nox was the goddess of LIGHT LOVE DARKNESS BEAUTY 

Medes refers to RELICS INSTITUTIONS GODS NATION 

Enzymes are found in the NERVES STOMACH BLOOD BONES 

A vertebra is a section of the LEG BONE MUSCLE SPINE 

The number of teeth in an adult is 32 30 28 34 

The early Egyptians disposed of their dead by BURNING EMBALM- 
ING BURIAL EXPOSURE 

A whale is classified as a FISH MAMMAL REPTILE AMPHIBIA 

. The Delco System is used in PLUMBING FILING IGNITION 
CATALOGUING 

Aggassiz was an EXPLORER NATURALIST DIVINE SOLDIER 

. Clemenceau is an INVENTOR POET SOLDIER STATESMAN 

. Silk comes from a kind of cRAB WORM BEETLE PLANT 

. To set fire to a house is called LARCENY INCEST MAYHEM ARSON 
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TABLE 3 
The per cent of each quartile answering each of the forty best questions 
correctly, the final value assigned, and the difficulty of the question 
CULUS elaine — _ : - — 
PPING QUESTION Ql Q2 Q3 | VALUE 8.D 
DDING : 3 ~ : 
63 36 : 62 
' 54 
54 
53 
53 
52 
50 
47 
47 


45 
44 
44 
43 
43 
42 
41 
41 


GLAND 
ISTOL 
LROAD 


40 
39 
38 
38 
38 
37 


36 
34 
33 
33 
32 


32 
32 


30 
30 
30 
30 
30 
30 
30 
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have said in advance that 98 per cent of freshmen would mark 
the correct answer in ‘Fulton’s Folly” was the name of 4 
BOOK AIRPLANE STEAMBOAT COTTON GIN” (this before 
the widely attended moving picture) and only 41 per cent mark 


TABLE 4 


The per cent of each quartile answering each of the twenty-five poorest 
questions correctly, the final value assigned, and the difficulty 
of the question 


QUESTION ) Q3 


o4 


10 

ll 

12 

13 

14 

15 

16 | | 15 

- | 

is | 64 

19 > 6 | (66 

20 | 48 27 33 
21 48 47 44 
22 13 15 13 
23 74 9 | 66 
24 #| «75 75 7 

2% | 3 39 «| (37 29 


61 
45 
43. 
54 


os] Ore “7 bo Or OO lo ¢ 





correctly ‘““The Makings of a Nation is an advertisement of 
& TOBACCO FLOUR BAKING POWDER HEALTH FOOD” when 
the answer stares at them from every bill board? This last 
question, surprisingly or not, was the second best of the entire 
list. Among questions so difficult that even the upper quartile 
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gave only the approximate chance score were those asking the 
location of the Pantheon and the battle of Waterloo, the nature 
of a soviet, the authorship of the “Rise of the Dutch Republic” 
and the nature of asteroids and of catalepsy. 

Since test elements are often evaluated one year for use the 
next, it becomes desirable to know the stability of questions 
from year to year. Fifty of the two hundred thirty information 
questions used in this study were given to classes in psychology 
under similar conditions in successive years. In the intelli- 
gence test given to all freshmen students the mean score for the 
entering class of 1922 was 59.2 and for the class entering in 
1923, 59.4 points. The dispersion of scores for the two classes 
was the same. The mean difficulty of the fifty information 
questions was 51.2 for the class of 1922 and 51.4 for the class of 
1923. The mean value of the questions as measured by the 
cumulative totals of differences between quartiles was 18.0 for 
each class. The average deviation of the differences in difficulty 
of the questions was 3.7. The average deviation of the cumu- 
lative difference between quartiles was 3.0. The value of the 
questions is seen to be rather more variable than their reliabil- 
ity. However, 17 of the 20 best questions selected with the 
1922 class hold their rank among the best 20 with the entering 
class of 1923. Although the successive freshmen classes had 
given almost identical scores in every trait measured the high 
stability of the information questions was something of a sur- 
prise. Whether or not the results found here are typical can 
be shown only by comparisons extending over a number of years. 

In the absence of actual trial there is no justification for the 
assertion that questions found valuable at the University of 
Washington will have even approximately the same value when 
given to students in other localities. It is highly probable that 
in spite of the educational and cultural uniformity of the United 
States there are large local differences in the kinds of informa- 
tion possessed by college freshmen. These differences could 
be brought out in an interesting fashion if the various depart- 
ments that have given the Army Alpha test to their students 
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would re-score the papers of those who attempted every ques- 
tion in Test 8 and announce the per cent of correct answers 
given on each test element. 


CONCLUSIONS 


1. The empirical method should be extended to include each 
element in an information test. 

2. It is impossible to determine with accuracy the value of an 
information question by inspection alone. 

3. The stability of difficulty and distributing value of in- 
formation questions is sufficiently large so that questions can be 
evaluated one year for use the next. 





VALIDITY OF CHARACTER JUDGMENTS BASED ON 
EXTERNAL CRITERIA 
GLEN U. CLEETON 
Carnegie Institute of Technology 
AND F. B. KNIGHT 


University of Iowa 


INTRODUCTION 


Industry, fully aware of the advantage of an accurate and 
dependable means of estimating men and women, gives ear to 
any method of judging character which is at all plausible and 
which is earnestly presented. At the present time many so- 
called character analysts, consultants, and experts are present- 


ing both plausibly and earnestly methods of judging charac- 
ter based on physical criteria, such as head measurements. 
Respectable psychology almost without exception repudiates 
such methods and its foundations on physiological and neuro- 
logical grounds. The futility of character judgments by any 
form of phrenology is refuted theoretically to the queen’s taste 
in a conclusive onslaught by Knight Dunlap in an article pub- 
lished in The Scientific Monthly, vol. XV, no. 2, August, 1922. 

But business uses phrenological methods of character judg- 
ment rather freely and with some satisfaction. Science and 
psychology for their own purposes need only theoretical refuta- 
tion. Business evidently is not sufficiently impressed with 
theory. Perhaps statistical refutation will help in this con- 
nection and round out even the academic treatment of phrenol- 
ogy. This study furnishes such statistical refutation. 
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THE METHOD OF THE PRESENT STUDY 


First: Systems of character judgments by external signs 
were searched to find definite physical traits varying amounts 
of which are claimed toindicate varying amounts of some charac- 
ter trait. Measurement of such physical traits were made. 

Second: Groups of individuals were judged casually for 
specific character traits. There is a possibility that character 
may be judged by external signs and then the wrong signs 
reported. That is, by intuition true judgment may be made 
but the judges are unaware of how judgments are made; and 
so very naturally report some method. 

Third: Close associates who knew the characters of the 
members of each group carefully rated the members of each 
group to establish the facts relative to the varying amounts of 
certain traits possessed by members of each group. 

Fourth: The three measurements were correlated. 


GENERAL CONCLUSION 


For the busy reader the following sentence contains the meat 
of this statistical refutation of methods of character judgments 
by external criteria. The average of 201 correlations between 

variations in physical traits purported to reveal variations in 
character traits and our criteria was 0.000 with the correlations 
varying from 0.000 as chance would account for. 

Statistically: In a normal distribution 50 per cent of the cases 
come within 1 P.E.; 51.24 per cent of the correlations between 
physical traits and character traits came within 1 P.E. Ina 
normal distribution 82.26 per cent of the cases fall within 2 P.E. 
Of the 201 correlations reported here 83.08 per cent of them 
come within 2 P.E. In a normal distribution 95.70 per cent of 
the cases come within 3 P.E. In this study 98.01 per cent 
of the correlations come within 3 P.E. In a normal distribu- 
tion 99.30 per cént of the cases fall within 4 P.E. One hundred 
per cent of the correlations in this study fall within 4 P.E. 
Statistically then the correlation between variations in physical 
traits and character traits is 0.000 (within the reliability of our 
data). 
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CHARACTER TRAITS STUDIED 


The following character traits were the ones used in this 
study. 
Sound Judgment 
Intellectual Capacity 
Frankness 
Will Power 
Ability to Make Friends 
Leadership 
Originality 
Impulsiveness 


[hese traits were used primarily because a study of the litera- 
ture of both modern and historic phrenology revealed great 
disagreement among the doctors as to just what various physi- 
cal symptoms really indicate. There was less disagreement 
among the phrenologists on these traits than upon others. 

It is noteworthy that when allowances for form of statement 
due to a growing language are made the writings on character 
analysis of the present day are practically the same as they 
were one hundred and twenty years ago and strikingly similar 
to the pronouncements of the employment consultant Theo- 
phrastus of Eresos who lived 372 to 288 B.C. 


THE MEASUREMENTS OF PHYSICAL TRAITS 


Since absolutely accurate and tested anthropometric instru- 
ments seemed to avoid an error of about 1 mm. the slightly 
additional reliability of such instruments was not considered 


necessary. Character analysts use their eyes. We used 
instruments which must have made our measure at the worst 
far more accurate than theirs at the best. Our kit contained 


a) Standard spreading calipers 

(b) Sliding compass 

c) Steel tape 

d) Head square—constructed for the purpose upon the principle 
of the multiple sliding compass to facilitate measurements of 
distances from the meatus to various sections of the cranium, 
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The following are samples of the measurements made and 
correlated against our criteria. The basis for the selection of 
these measurements was the fact that, in one or more of the 
many authoritative accounts of character analysis, these 
measurements were purported to measure some trait under 
study. In many instances the measure used was explicitly 
stated to reveal the character trait study. In some instances 
inference from rather vague assertions had to be made. 

It is needless to repeat here the lists of physical factors used 
in connection with all the character traits studied. In testing 
the hypothesis that certain physical factors indicated Will 
Power 36 physical factors were measured. In testing the 
hypothesis that certain physical factors indicated Friend Mak- 
ing Ability 13 physical factors were measured. In testing the 
hypothesis that certain physical factors indicated the trait 
Leadership 30 factors were measured. For the trait Original- 
ity 23 factors were studied. For the trait Impulsiveness 20 
physical factors purporting to indicate this trait were used in 
this study. 


SUBJECTS OF THE STUDY 


Neglecting certain preliminary work the study was based on 
three groups, 10ineach. Two of these groups were members of 
two national sororities. The other group were members of a 
national fraternity. The main reason for using members of 
close social organizations was the fact that judgments of the 
several aspects of their character could be obtained. Each 
member of all our groups could be rated by a much larger group 
of judges who knew intimately not only the individual subject 
rated but also every other member of his group. In this way 
a man to man rating could be set up and many of the pit-falls of 
ratings overcome. 


THE RELIABILITY OF THE RATINGS 


The ratings of the close associates. These ratings were used 
as the criteria of the character traits. The reliabilities of these 
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TABLE 1 
Outline of factors used in the study of trait judgment 





Hypotheses: That judgment is indicated by the following physical 
factors: 
A. Large cranial development 
Measured by: 
(1) Cireumference—anterior inferior to posterior central 
(2) Circumference plus height of head from meatus vertical 
(3) Length of head—glabella to occipital protuberance plus 
height plus maximum breadth 
B. High development of anterior lateral region 
(4) Width of head at temples 
C. High development of upper part of forehead 
(5) Breadth frontal eminences 
(6) Length from meatus to anterior superior 
(7) Length from meatus to anterior superior plus breadth of 
frontal eminences 
D. High development of the entire anterior region 
(8) Average breadth of forehead 
(9) Average length from meatus to anterior regions 
(10) Average breadth of forehead plus average length from 
meatus to anterior regions 
(11) Average breadth of forehead plus length meatus to anterior 
regions plus height of head 
(12) Ratio—-Anterior length of head : posterior length of head— 
measured from meatus 
(13) Ratio—Anterior inferior length : posterior central length— 
measured from meatus 
(14) Ratio—anterior superior length : posterior central length— 
measured from meatus 
E. Wide head 
(15) Maximum breadth of head 
(16) Cephalic index 
(17) Breadth divided by height index 
(18) Breadth divided by (height plus length) index 
F. Great breadth between eyes 
(19) Eye to eye center 
G. Arched nose 
(20) Average length from meatus to root and tip of nose sub- 
tracted from length meatus to bridge of nose 
H. Small eyes 
(21) Eye opening vertical (inverse) 
(22) Breadth of eyes horizontal (inverse) 
(23) Vertical opening of eyes plus breadth (inverse) 
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TABLE 1—Continued 
Broad blunt facial features 
(24) Average breadth of nose 
(25) Breadth of mouth 
(26) Breadth of chin 
(27) Breadth of nose plus breadth of mouth plus breadth of chin 
Vertical forehead profile 
(28) Length meatus to anterior superior less length meatus to 
anterior inferior 


TABLE 2 


Outline of factors used in the study of trait intelligence 


Hypotheses: That intelligence is indicated by the following physical 
factors: 
A. Large cranial development 
Measured by: 
(1) Cireumference—anterior inferior to posterior central 
(2) Circumference plus height of head from meatus vertica 
(3) Length of head—glabella to occipital protuberance plus 
height plus maximum breadth 
Large ratio head development to body 
(4) Cireumference—anterior inferior to posterior central 
divided by weight 
(5) Circumference plus height of head divided by weight 
(6) Height plus breadth plus length of head divided by weight 
Wide forehead 
(7) Average width of forehead 
. Prominent anterior superior region 
(8) Breadth frontal eminences 
(9) Length from meatus to anterior superior 
(10) Length from meatus to anterior superior plus breadth of 
frontal eminences 
Prominent anterior lateral region 
(11) Breadth of head at temples 
High head 
(12) Height meatus to top of head 
(13) Height divided by length index 
(14) Height divided by breadth index 
(15) Height divided by (breadth plus length) index 
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TABLE 2—Continued 
G. Great length from ears forward 
(16) Meatus to anterior inferior 
(17) Ratio—average anterior length : average posterior length 
of head 

(18) Ratio—anterior inferior length : posterior central length— 

of chin measured from meatus 
. Great breadth between eyes 
atus to (19) Eye to eye center 
Small eyes 

(20) Eye opening verticle (inverse) 

(21) Breadth of eyes horizontal (inverse) 

(22) Vertical opening of eyes plus breadth (inverse) 

Large facial features 
3) Average breadth of nose 
4) Breadth of mouth 
5) Breadth of chin 
6) Length plus height of nose 
7) Breadth of nose plus breadth of mouth plus breadth of chin 
, eae nose 

al (28) Length of nose 
rtical , Straight nose 


92 

9 

hysical (2 
G 

97 


ce plus (29) Average length from meatus to root and tip of nose sub- 
tracted from length meatus to bridge of nose 


central 

TABLE 3 
ht ee oe ; 
weight Reliability of ratings of close associates 


Ratings of first half (10 close associates) taken in chance order correlated 
with ratings of second half (10 close associates) taken in chance order 


GROUP GROUP GROUP 
Ww Ep x ey Y *? 
TRAIT ao | PE-| @ | P-E-| @ | P-E- 
CASES) |CASES) CASES) 
adth of i we 


Judgment — .| 0.920.032) 0.97:10.013; 0.96.0.0170.950 
Intelligence... . - 92 0.032 790.084 0.830.0700.846 
Frankness........ ie easier 330.190) 0.680.120, 0.79 0.0840. 600 
Will Power....... 830.064 0.780.087 0.960.016.0856 
Ability to Make F riends au ah 730.095 0.410.186. 0.750.098 0.630 
Leadership : 780.084 0.870.054 0.83:0.070.0.826 
Originality 810.072, 0.710.111) 0.80.0.081,0.773 
Impulsiveness........ 610.133, 0.930.030 0.78 0.087 0.773 
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ratings were obtained by correlating half of the judgments 
against the other half for the ratings of each trait. The self 
correlations are reported in table 3. 

Groups W, X and Y are the three groups keyed for obvious 
reasons. 


HALO IN RATINGS BY CLOSE ASSOCIATES 


In order to determine the probable amount of halo effect in 
these analyzed ratings the inter-correlations between all the 
traits were computed. We do not know what the inter-correla- 
tions actually are. However if all the inter-correlations were 
1.00 we would be certain that all that had been obtained was a 


TABLE 4 


Inter-correlation of trait judgment with the remaining seven traits 





Group | » GROUP| pp | GROUP | 7 
| we | PE. (*2°F| PE. | PF | PE 


AVERAGE 
| 


Intelligence | 0.890.045, 0.690.117) 0.910.039, 0.830 
Frankness | 0.710.106 580.148; 0.930.030) 0.740 
Will Power................ | 0.68/0.113) 0.91/0.039] 0.960.017] 0.853 
Ability to Make Friends...| 0.760.090, 0.550.157, 0.830.070) 0.713 
Leadership | 0.910.034) 0.980.008 0.910.039 0.933 
Originality | 0.690.111) 0.500.169} 0.590.146 0.593 
Impulsiveness —0.420.175) 0.170.218, —0.22.0.215 —0.156 





general estimate under many different names. Space will 
not permit the insertion here of all the tables of inter-correla- 
tions. One table (table 4) is inserted. This table is typical of 
all the others rendered by the close associates. 

The distribution of all the inter-correlations of ratings of close 
associates is given in table 5. 

We have then very reliable ratings of three groups. Each 
group was rated by men or women who live in the closest 
association with the subjects studied. They presumably know 
the subjects studied. Over-estimation was avoided by the maa 
to man method of'rating. The inter-correlation between traits 
are on the whole reasonable. The number of judges used in 
rating each group was twenty. 
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nents TABLE 5 


e self Average inter-correlation of traits—ratings of close associates 


A. Average inter-correlation 0.85 to 1.00 
vious 1. Judgment and Will Power 
2. Judgment and Leadership 
3. Will Power and Leadership 
B. Average inter-correlation 0.55 to 0.84 
: 1. Judgment and Intelligence 
ect in 2. Judgment and Frankness 
ll the . Judgment and Ability to Make Friends 
rrela- . Judgment and Originality 
5. Intelligence and Frankness 
. Intelligence and Will Power 
. Intelligence and Ability to Make Friends 
. Intelligence and Leadership 
; 9. Intelligence and Originality 
its . Frankness and Will Power 
. . Frankness and Ability to Make Friends 
. Frankness and Leadership 
13. Frankness and Originality 


were 


Was a 


\VERAGE 


0.830 





0.740 14. Will Power and Ability to Make Friends 
0.853 15. Leadership and Originality 
0.713 16. Leadership and Ability to Make Friends 
0.933 C. Average inter-correlation 0.35 to 0.54 
0.593 1. Will Power and Originality 
0.156 2. Ability to Make Friends and Originality 
oe 3. Originality and Impulsiveness 
D. Average inter-correlation below 0.35 
. will 1. Judgment and Impulsiveness 
rrela- 2. Intelligence and Impulsiveness 
cal of 3. Frankness and Impulsiveness 
4. Will Power and Impulsiveness 
5. Ability to Make Friends and Impulsiveness 
close . Leadership and Impulsiveness 
~ THE RELIABILITY OF RATINGS BY CASUAL OBSERVERS 
oses 
know Each of the three groups which were rated by their close 
man associates and members of which were character analyzed were 
traits also rated by casual observers. The procedure was as follows: 


ed in Each group in turn were seated upon a stage and seventy 
judges rated them for the eight traits used in this study. The 
casual observers were composed of business men, school superin- 
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tendents and students of personnel management. Most of 
the group were accustomed to judging men and women with 
possible employment in view. As far as could be learned none 
of these judges used any “system” of judgment consciously, 
Each group remained on the stage long enough for even the 
satisfaction of the most deliberate judge. The ratings thus 
obtained were divided into two groups and the self-correlation 
of the ratings obtained. These are our measure of the relia- 
bility of casual observation. 
thus obtained. 


Table 6 reports the correlations 


TABLE 6 
Reliability of ratings of casual observers 


Ratings of first half (35 observers) taken in chance order correlated with 
ratings of second half (35 observers) taken in chance order 


GROUP 
. Ww ts 
TRAIT (10 P.E 
CASES) 


GROUP GROUP 


(10 
CASES) 


ao | PE 
CASES) 


Judgment 
Intelligence 
Frankness........ 
Will Power....... 


Ability to Make Friends.... .. 


Leadership 


88 0.048 
.91\0.034 
510.157 
990.004 
0.870.050 
0.73)0 .099 


0.98 0.008 
0.960.016 
0.960.016 
0.960.016 
0.900.041 


0.9210.019 0 
0.900.0410 
| 0.74:0.093'0 
0.95/0.021/0 
0.890.045 0 


926 
923 
736 
966 
886 
800 


0.880.051) 0.79/0.081)0 
0.62/0.130) 0.950.021) 0.78/0.084 0 
| 0 78/0 .084 0.99,0 004; 0 86/0 .055 0 


Originality 
Impulsiveness 


783 
876 


It is noteworthy that casual observation right or wrong is 
nevertheless fairly consistent. Whatever physical signs go to 
impress a casual observer seems similarly to impress other 
casual observers. The two traits that casual observers have 
the least agreement about are frankness and originality. 


HALO IN RATINGS BY CASUAL OBSERVERS 


It was also desirable to compute the inter-correlations be- 


tween the several traits as judged by casual observers. Table 
7 reports the inter-correlations between the trait judgment and 
the other traits. It is fairly typical of all the inter-correlations. 

The summary of all the inter-correlations between traits as 
judged by casual observation is contained in table 8. 





rABLE 7 
Inter-correlation of trait judgment with the remaining seven traits 
Ratings of casual observers 
’ , GROUP GROUP GROUP 
St a TRAIT pA P.E (10 E. (10 
with CASES) CASES) CASES) 


P.E 


I a j oo : - 
nm Intelligence................-.| 0.940.025]. 0.870.050, 0.90.0.041'0.903 


ously, Frankness...... .....| 0.250.199' 0.730.099 0.38 0.182:0.453 
nN the Will Power.... ......-| 0.850.059| 0.82,0.067, 0.93\0.029 0.866 
thus Ability to Make Friends......| 0.320.191) 0.650.122 0.35,.0.187,0.440 
lation Leadership. . ... 0.640.125) 0.830.069) 0.620.1300.696 
relia- Originality. . be alae ...| 0.860.055 0 160 208) 0.8710.050/0.630 
wea Impulsiveness... .. ....| 0.32:0.191)—0.35 0.187) 0.44/0.172/0.136 


TABLE 8 


Average inter-correlation of traits—ratings of casual observers ZL 


A. Average inter-correlation 0.85 to 1.00 (P.E. 0.059 to 0) 
d with 1. Judgment and Intelligence 
r 2. Judgment and Will Power 
B. Average inter-correlation 0.55 to 0.84 (P.E. 0.149 to 0.062) 
1. Judgment and Leadership 
2. Judgment and Originality 
3. Intelligence and Will Power 
4. Intelligence and Leadership 
923 5. Intelligence and Originality 
736 6. Will Power and Leadership 
966 7. Will Power and Originality 
886 8. Leadership and Originality 
0 800 C. Average inter-correlation 0.35 to 0.54 (P.E. 0.220 to 0.188) 
(0.783 1. Judgment and Frankness 
0.876 2. Judgment and Ability to Make Friends 
3. Intelligence and Ability to Make Friends 
ng is 4. Frankness and Intelligence 
5. Frankness and Ability to Make Friends 
6. Impulsiveness and Ability to Make Friends 
D. Average inter-correlation 0.04 to 0.34 (P.E. 0.220 to 0.188) 
have 1. Judgment and Impulsiveness 
. Intelligence and Impulsiveness 
. Frankness and Will Power 
Frankness and Leadership 
Frankness and Originality 
. Will Power and Ability to Make Friends 
. Will Power and Impulsiveness 
. Ability to Make Friends and Leadership 
9. Ability to Make Friends and Originality 
10. Leadership and Impulsiveness 
11. Originality and Impulsiveness 
____ 12. Impulsiveness and Frankness 
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CHARACTER JUDGMENTS ON EXTERNAL CRITERIA 


THE RELIABILITY OF MEASUREMENTS BY EXTERNAL SIGNS 


It will be remembered that the reliability of judgments by 
close associates and even by casual observers using no particu- 
lar “system” was high. It will be useful to know that the 
reliability of judgments based upon the ‘‘authoritative” physical 
measurements possess no such agreement. ‘When a group is 
measured for those physical factors purported to reveal judg- 
ment we find that the measures do not agree among themselves. 
Table 9 shows the inter-correlations between ten physical 
factors supposed to measure the same trait. This is typical 
of the agreement between other physical measures purporting 
to measure the same trait. 

No better agreement is found when we find the inter-correla- 
tions of the total 28 factors used in measuring Judgment, as 
table 10 shows. 


CORRELATIONS BETWEEN RATINGS OF CLOSE ASSOCIATES AND 
PHYSICAL FACTORS 


In correlating the measures of character gained from physi- 
cal measurements with those obtained from the judgments of 
close associates two methods were used throughout this study. 
First the correlation between the two types of character esti- 
mate was computed for each of the three groups. Second the 


members of each group were thrown into one array as follows. 


Each rating was changed to a standard measure and thus the 
scores of all the gréups become comparable. The formula 
for transferring ratings of any one group to scores for a total 
group was 

Score — true mean 


——————— ——— = standard measure 
Standard deviation 


In this way 28 cases could be studied at once. 

Further in view of the fact that the different factors purport- 
ing to measure any given character trait correlated so poorly 
with each other that it would be impossible to build up a one best 
measure of any trait we have correlated each separate physical 
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TABLE lil 


Correlations existing between ratings of close associates and phy 
factors 


Pearson product-moment method trait judgment 
STAND- 

ARD 

MEAS- EP 
acme P.E. 


Group W 
(10 
CASES) 


PHYSICAL FACTOR 


(28 


CASES) 


A-l —0.04 32) 0.191) —0.24) 0.213) —0.3: 
A-2 —0.10 3} 0.153' —0.21) 0.216) —0.: 

A-3 —0.12 | 0.217) —0.29) 0.206) —0.: 

B-4 0.21 0.221, 0 214, 0.5: 
1-5 —0.06 32) 0.191) —0.02) 0.225) 

C-6 —0.04 34| 0.188) 0 215 

CF 0.08! 180, —0.13| 0.220 32 
D-8 217, +O 224 23 
D-9 | 0.06) 149, —0:: 209) 37 
D-10 | 0.05) 220 —0.0! 223 63 
D-11 | —0.04| 221, —0.28) 0.207 01 
D-12 0.29) 182) 0.23) 0.214 69 
D-13 0.38) 155) —0 224 74 
D-14 0.31) 185) 0.3% 200) 65 
E-15 0.09 209 —0. 222) —0.21 
E-16 —0.09) 207; —0O 224) —0.32 
E-17 0.00) .59| 0.139, 0. 206} 0.34 
E-18 —0.01) 0.127) 291 0.195) 0 214) 0.20 
F-19 202) —0.53) 


—0.14| .23| 161; —0.21| 
G-20 | 0.03) | 0.16} 0.208) 0 225 0.08) 
H-21 0.06| 37 0.183, 0 220] 0.02 
H-22 —0.07| 0. 0.00) 0.222) —0.; 204, —0.33 
H-23 —0.04! 0.15} 0.209, —0. 215) 0.04 
1-24 —0.27| 18} 0.207; —0.22| 0.215) 0.43 
1-25 | —0.34 0.09; 0.213) —0.: 151) —0.46 
1-26 —0.07 0.54) 0.151 148 0.04 
191, —0. .087| —0.04 


1-27 —0.12) 0. 0.32 
J-28 | —0.20) 0.122) —0.18) 0.207 200| —0.22 


_ 


| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 


;oooooooooooooooooooce 
}oooooooooooooooecco 


Average .. .;—0.005 


| 
i 





measurement with the ratings by close associates. Since many 
physical measures might be false yet some might be true. It 
will be too prodigal of space to report all of these correlations 





0). 192 
0). 203 
0.198 
0.164 
0.225 
0.210 
0.201 
0.214 
0.193 
0.135 
0.225 
0.117 
0.101 
0.129 
0.216 
0.201 
0.198 
0.216 
0.216 
0.223 
0.225 
0.200 
0.224 
0.182 
0.177 
0.224 
0.224 
0.215 
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for every trait studied. Table 11 is a full report of the correla- 
tions for one character trait. In further instances averages 
alone will be reported. 
\VERAGE CORRELATIONS BETWEEN RATINGS BY CLOSE ASSO- 
CIATES AND PHYSICAL FACTORS FOR EIGHT TRAITS 

It is unnecessary to report all the correlations between the 
ratings by close associates for a given trait and the many 
physical factors purporting to reveal that given trait. Table 


12 reports the average correlation between ratings and the 


physical factors. 
TABLE 12 
Average correlations—physical factors and close associates; physical factors 
and casual observers 
CLOSE CASUAL 
ASSOCIATES OBSERVERS 


AND PHYSICAL AND PHYSICAL 
FACTORS FACTORS 


Judgment........... pie , —0.005 +0.145 
Intelligence........ oe y= Ao oe Re ns +0 027 +0.051 
Frankness...... ae — +0 .055 +0.155 
Friendliness. .... ......... a —0.11 +0.195 
Will Power pated et [eee —0.074 +0 .036 
Leadership........ eee —().041 +0 066 
Originality..... ates ; +0 .095 +0.079 

+-0.100 —0.067 

The number of different physical factors used varied from 

36 for Will Power to 13 for Ability to Make Friends. 


THE AGREEMENT BETWEEN CLOSE AND CASUAL OBSERVERS 


Table 13 gives correlations between close and casual 

observers. 
CONCLUSION 

While the correlations secured between the ratings of close 
associates and casual observers show a general positive tendency 
they are not of sufficient magnitude to warrant any importance 
being attached tothem. The highest correlation secured is less 
than four times its probable error. 





230 GLEN U. CLEETON AND F. B. KNIGHT 


The highest average correlation presented is 0.323. Such 
a correlation measured on the basis of the standard error of 
estimate formula: 


Sigma = 1X vi — 72 
would have a value of 5.6 per cent better than chance. The 
highest single correlation secured was 0.58. Such is 18.6 per 
cent better than chance. 
TABLE 13 


Correlation existing between ratings of close associates and ratings of 
casual observers 





GROUP | 
4 | . ER- 
9 | P.E. AVER 
( | AGE 


CASES) | 
| 


| P.E 
CASES) 


! 
| 
TRAIT 
| 
| 


Judgment | 0.29'0.195) 0.48'0.172| 0 18|0 21710. 31 
Intelligence | 0.040.220) 0.26/0. 210) —0.23/0.214/0.023 
RES ee | 0.11/0.211| 0.310.203! 0.21/0.2160.210 
Will Power | 0.02/0.221| 0.580.148) 0.1910.217.0.263 
Ability to Make Friends......| 0.53'0.153| 0.31|0.203 —0.30|0.204/0. 130 
Leadership | 0.40/0.179 0.080.223) 0.46/0.1770.313 
Originality | 0.430.174) 0.470.175, 0.07/0.223 0.323 
Impulsiveness................| 0.330.189) 0.37/0.193 —0 10}0.2220 200 





SUMMARY OF STUDY 


This study was undertaken to supply statistical basis for the 
truth or falsity of the theery and practice of character analysis. 
Theoretical refutation already exists in ample amount. From 
the facts reported and treated in this study the following con- 
clusions receive clear support. 

1. The ratings of close associates are reliable. 

2. The ratings of 70 casual observers are reliable. 

3. The physical factors purporting to measure the same trait 
do not present even a suspicion of agreement. 

4. The correlation between ratings of close associates and 
casual observers is slightly better than chance. 

5. The correlation between ratings of casual observers and 
physical measurements is best represented by 0.000. 





7'0.316 
4/0 .023 
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7\0.263 
40.180 
7\0.313 
3:0. 323 
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6. The correlation between close associates and physical 


measurements is best represented by 0.000. 

7. Physical measurements which underly character analysis 
agree neither with themselves nor with other measures of 
character. 





ADVERTISING APPEALS SELECTED BY THE 
METHOD OF DIRECT IMPRESSION! 


RICHARD B. FRANKEN 


New York University 


The “Order of Merit’? method as used in ranking advertise- 
ments has so often been discussed by Hollingworth,? Strong, 
Starch,‘ and others that a mere mention of it here should suffice. 
In the majority of cases where these authors have made use of 
this ranking method the number of advertisements have been 
limited to twenty or less; even when twenty advertisements 
were used it was thought so difficult to get a true order of 
merit directly that the subjects making the ranking were 
instructed first to separate the advertisements into groups, such 
as Very strong, Strong, Weak, Very weak, or otherwise, to 
facilitate ranking. The greater the number of advertisements 
the more difficult ranking them becomes, even with the help of 
separating them into groups. If one had, for example, about 
1700 proposed drug signs 16 inches square to rank,—as was 
the case when Professor Woodworth and the writer tried to 
select a suitable sign for the Rexall Drug Company,—the task 
would become quite impossible. Thus some other method 
must necessarily be used if one has a great number of 
advertisements or other material upon which he desires to 
have scientific judgment passed. 


1 The writer wishes to express his thanks and appreciation to Prof. 
Harry D. \Xitson, University of Indiana, and his students for their kind 
cod peration, without which this paper would not have been possible. 

? Harry L. Hollingworth, Advertising and selling, Chapter I. 

’ Edward Kk. Strong, Jr., The relative merit of advertisements, Ar- 
chives of Psychology, no. 17, July, 1911. 

‘ Daniel Starch, Advertising, Chapter XXII. 
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The prime purpose of this article is to illustrate and discuss a 
method: the ‘“‘Method of Direct Impression’’—which has been 
used by Galton® in measuring mental imagery; by Titchener® 
in studying the affective qualities of a series of colors; by Strong? 
in securing degrees of confidence in recognition of a series of 
advertisements; ete.—and to show how this method may be 
applied to selecting the best advertisements or sales appeals 
from among any number of potential appeals. 

For the purpose in hand a number of hosiery advertisements 
were selected from some of the leading national magazines. Al- 
though in many cases such pictorial presentation as “beauty” 
in hosiery predominated the advertisement, only the printed 
copy of these advertisements was carefully analyzed, and 77 
somewhat overlapping, selling points or phrases, such as ‘Silk 
stockings that wear,” ‘‘Value for the price,” etc., were mimeo- 
graphed on sheets of paper and distributed to four groups of 
students (160 men and 75 women) taking a course in Psychol- 
ogy of Advertising at New York University Summer School 
(1922) and at the University of Indiana (1922). The students 
were directed to rate the sales points as follows: 0, very weak; 
1, weak; 2, strong; 3, very strong. The mimeographed sheets 
containing the instructions and the 77 sales appeals are repro- 
duced herewith. 


Each statement represents a possible selling point or advertising ap- 
peal for hosiery. Please mark all of these according to the degree in 
which they appeal to yéu personally, persuade you, or interest you in the 
product, as follows: 


Mark very strong—3 
Mark strong—2 
Mark weak—1 

Mark very weak—0 


* Francis Galton, Inquiries into human faculty and its development, 
pp. 57 to 77. 

§ Edward B. Titchenor, Experimental psychology, vol. I, pp. 154-8. 

’ Edward K. Strong, Jr., The Psychological Review, vol. XIX, no. 
6, November, 1912. 
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ANALYSIS OF ARGUMENTS FOR HOSIERY 


. The best of service. 
. Made of tested combed yarn. 
3. Specially dyed. 
. Finished to retain the yarn in its greatest natural strength. 
. Reinforced heels and toes. 
}. Specially constructed to guarantee long wear. 
. Maintain original high quality. 
8. Don’t speculate with the money you invest in silk stockings. 
. There is a certain satisfying value. 
. They’re garter proof. ‘‘No run that starts above can pass the gold 
stripe.” 
. Silk stockings that wear. 
2. Good as they look. 
3. You get what you pay for. 
. Washing won’t hurt them (don’t get a cheap silk—it goes in the first 
wash). 
5. Be sure you get fresh stock when buying silk hose (new shipments 
just arrived in all desirable colors). 
. All the qualifications of a guaranteed hose at half the price. 
. Quality first. 
. Don’t wear out as quickly. 
. Value for the price. 
. Long staple yarn. 
. Single sole with triple heel and toe. 
. Prolong the life by changing daily or oftener for summer. Change 
your socks and your shoes—it’s a very restful thing to do. 
3. Full fashion fits shape of the foot. 
. Do not hang baggy. 
. No seam to chafe or rub the skin. 
. Snug fit prevents chaffing the feet. 
. Fit like a glove. 
. Tested for strength. 
9. Strong threads. 
. Absolute fast colors guaranteed (new pair or your money back). 
. Guaranteed 6 months. 
. Guaranteed to give satisfaction. 
3. Wear well. 
. Fit well. 
. Stylish. 
. Pure silk. 
. Fast colors. 
. Fast colors guaranteed. 
. Double heel and toe. 
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. Seamless. 
. More stitches per inch. 


2. Closer knit (or woven). 
3. Reinforced where the wear comes. 


. Best for 50 years. 
. Made in daylight plant. 


3. Every pair will fit and wear satisfactorily. 


. Snug fit at the ankle. 


3. The sheer beauty of - 


. Wears as well as it looks. 
. In many weights and shades. 
. Pure thread silk 


52. The first socks in America to be knitted by machinery were made 


at ————— in 1822. 


53. 97 years ago. 
54. More than 50,000,000 pairs of ————— that gave satisfaction last 


year. 


5. Doing one thing well for almost a century. 
56. Satisfying the needs of human feet. 


. Oldest and one of the largest hosiery mills in the United States. 


58. Why have holes in your hosiery? 

9. Reinforced hosiery for men, women, and children. 

0. Makes a sensible gift for men or women. 

jl. It furnishes the kind of service that justifies the purchase. 

j2. Dependable wear and snug clean-cut appearance. 

33. Hosiery satisfaction. 

44. There’s real comfort for tired or tender feet in ——-——— fashioned 


hose. 


. The method of knitting these stockings is different. 
. Patent machines that “knit in’’ the proper shape and fit, without 


seams. 


537. No homely stitching up the back of the leg. 
38. No seams to walk on. 


Oe oe 
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. Just a soft smoothness that gives real comfort. 

. The fit is snug and firm everywhere. 

. There’s no room for wrinkles in ————— hose. 

. Extra elastic, narrow tip, prevents garter runs. 

. Style, quality and sound value. 

. Fascinating new designs in ————— silk hosiery for summer are 


certain to delight you. 


. Hosiery—each the best of its kind. 
. Home knit for our soldiers. 
. For those whose needs demand the essential combination of style, 


quality and sound value. 
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TABLE 1 
A tabulation of the rankings of 77 hosiery appeals by 160 males and 7 
females, listed according to the strength of the appeals as indicated 
by the results of the study 


APPEAL KEY NUMBER | 


AVERAGE 
RATINGS FINAL 
RANK 


THE SALES APPEAL 


AVERAGE 
Females 


| o 

| ~ 

! 

| t 

| ws 

| 

| TOTAL SCORE* 


1} 655 98'410'2.56 Reinforced heels and toes 
0} 425.46:189 2.51 


v 


o 


18/14 32 86 3462.16; 2 | Guaranteed six months 
6 17/16 36)157,2.09 


12/26 47 '65)335/2 .08) ; Single sole with triple heel and toe 
3/13 26/33) 164)2. 

| | | | 

| 5|27:79,70/334/2 Double heel and toe 

| 5} 2.39/28/164/2. 


| 7\26:78'49\309)1.93) &£ | Reinforced where the wear comes 


3| 6 27:39/177)2.: 
= 
10/42 62|46/303/1 .88 | Specially constructed to guarantee 
| 2/1431 28/160/2 |8 | long wear 
17 |14'40 64/42/2041 | Quality first 
| 614:25'30/154 2 


38 |24'26 61/49/293)1.81 Fast colors guaranteed 
| 6| 816145176 2.34 

36 |21/42'60'37 273'1.71| | Pure silk 
| 8 929291154 2.05! 


32 27 41 57:35'2601.62/10 | Guaranteed to give satisfaction 
51428281542.06, 12 





* The total score, column 6, is figured as follows: For example, ap- 
peal no. 5 which ranked first by the males and females was rated 1 by 6 
males 2 by 55; and 3 by 98; so that 1 X 6 = 6+4+2X 55 = 110+ 3 X 98 
= 294 = 6 + 110 + 294 = 410; etc. 410 + 160 (the number of cases) 
= 2.56 (column 7), average score given to the appeal by males. 
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TABLE 1—Continued 


AVERAGE 
RATINGS FINAL 
RANK 


NUMBER 


THE SALES APPEAL 


APPEAL KEY 
AVERAGE 


| TOTAL SCORE* 
Females 


25 40 67,28 258'1.6111.5 Seamless 
371912) 7; 640.85 


7 \23.45 63 29 2581.60)11.£ | Fit like a glove 
6 21:31/17,134/1.78 


15,53 66 24/257|1 .59)13 Tested for strength 
8 1835)14)130)1.73 2 


58)14 | The best of service 
34/49 64'23)/246)1 .53)1E | Extra elastic, narrow tip, prevents 
6) 7:31/30)159)2. 1: |9 | garter runs 
| | | 


12 24.54 70/2421 .51\16 Absolute fast colors guaranteed (new 
3| 7)1648)/183)2.44 2 | pair or your money back) 
| 


untee 2 23 6365/19 240/1 .50,17 | Dependable wear and snug clean-cut 
12,14 31/17|127|1 .69 25.5) appearance 


29/55 46 |30/237|1 48/18 Style, quality and sound value 
8 11/22 33/146,1 95, 


29\59'62'21/236)1 47/19 | Snug fit at the ankle 
6 27/26|16|127/1 .69 


| | | 
19,71 50/21/2341 .46 20 Strong threads 
19|22/22|12/102/1 .36 

; | 


29 56 49 26/232 1.45/21 | | Washing won’t hurt them (don’t get a 
12/29/22) 12/109/1 . 45) | cheap silk—it goes in the first wash) 
Bete 

| | | | | | 

25 48 68 29/230 1.4522 | | Pure thread silk 

| 614/29|26)150/2 00) 
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TABLE 1—Continued 


| 
| 
| 
| 
| 


AVERAGE 
RATINGS | FINAL 
RANK 


THE SALES APPEAL 


AVERAGE 
| Females 


| 





8 | APPEAL KEY NUMBER 


28 50.68/14 228) 1.42): | Fast colors 
7 jl 40) 17| en 
| 
59 | ‘21 64 61\14 22811. y | Reinforced hosiery for men, women 
6/23 31/15/130 }1.73) | and children 
| | | 


| | 
. '29| '58)49) 24 298)|1. 5 No seams to walk on 


psp 12) pepou IL. 
28/42 ape . | Just a soft smoothness that gives real 
12/20 an 5) a il. < comfort 


46|; sod \37| '228)1. 25 | They’re garter proof. ‘No run that 
3/10 15/49) '181\2. | starts above can pass the gold 
| | | stripe” 
| | 
21\65 ileal 28 | | Stylish 
22) « 18 pene 1.36) 








25) ler \47| 21 ‘224i. | Made of tested combed yarns 
“~ 35\16 5 82)1. 
| | 

\30) 46.64 20)224 1.40/29 .5| | More than 50,000,000 pairs of — 
2123/21/10) 9511.27) | that gave satisfaction last year 





} | | | 
22 64 63)11/2231.39)31 | | Makes a sensible gift for men and 
\10 23 3111 ane 57| , women 
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25 '39) 451522422111. 38132 | | No seam to chafe or rub the skin 
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7|10 29 28 150 2.06 .5| essential combination of style, qual- 
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70 |26 63 5912217 1.3534 The fit is snug and firm everywhere 
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THE SALES APPEAL 


Maintain wdabia high eniitte 


| Full fashion fits shape of the foot 


| Do not hang baggy 


Snug fit prevents chafing the feet 


Wear well 


| Silk stockings that wear 


| Good as they look 


| Fit well 


Finished to retain the yarn in its 
greatest natural strength 


Value for the price 


| Don’t wear out quickly 


| There’s no xoom for wrinkles in 


hose 
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THE SALES APPEAL 


There’s real comfort for tired or ten- 
der feet in — — fashioned hose 


| Wears as well as it looks. 


| Prolong the life by changing daily or 


oftener for summer. Change your 


socks and your shoes—it’s a very 
restful thing to do 


All the qualifications of a guaranteed 
hose at half the price 


Closer knit (or woven) 


Long staple yarn 


Doing one thing well for almost a 
century 


| It furnishes the kind of service and 


justifies the purchase 


| Oldest and one of the largest hosiery 


mills in the United States 


| Specially dyed 


Hosiery satisfaction 
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\21 32,19) 2) 761.01) 59 | 








RICHARD B. FRANKEN 


TABLE 1—Concluded 
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The results of this study are given in table 1. Column 1 of 
this table gives the key number of each sales appeal, indicating 
the position of its appearance on the original mimeographed 
sheet; columns 2, 3, 4, and 5 show the number of times each 
appeal was rated 0, 1, 2, and 3, for the males and females sepa- 
rately; column 6 gives the total score for each appeal; column 
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7 the arithmetic average; columns 8 and 9 the final rank for 
males and females; and column 10 the sales appeal. Thus 
the sales point, ‘‘Reinforced heels and toes,” ranked first by 
both males and females; the sales appeal, “‘Guaranteed six 
months,” ranked second by the males and tenth by the females; 
ete. The correlation between the final rank for the males and 
¥ 2 
females (Spearman Footrule r = 1 — a) is + 0.81 
n (n?—1) 

and the correlation between two groups of 60 males is + 0.82; 
thus the results may be considered fairly reliable for the groups 
among which the study was conducted. 

Since the results of this study are primarily given to illustrate 
the method as applied to advertising their practical value to the 
advertising copywriter may be questioned due to the inevitable 
factors that necessarily accompany the conditions under which 
the study was made. Chief among the objections are, that 
only the college-student consumer was studied; the difference 
between the artificial atmosphere under which the study was 
conducted and the conditions under which actual purchases 
are made; student reactions are not a perfect index of the general 
buyer’s attitude; etc. Nevertheless, the following deductions 
that may be of some use to the practical man are pointed out. 

The selling points vary widely in strength, the strongest 
appeal for males receiving an average score of 2.56, the weakest 
an average of 0.58; and for females the strongest average score 
is 2.51, the weakest 0.41. The appeals that show the greatest 
sex differences are numbers 40, 63, 74, and 10. These appeals, 
together with their final rank by each sex are listed as follows: 





| 
SALES RANK FOR | RANK FOR 
APPEAL TER APPRAL MALES FEMALES 





40 | Seamless 11.5 67.5 
63 Hosiery satisfaction 57 ; 2 
74 Fascinating new designs in 
hosiery for the summer are certain to 
delight you 60 
They’re garter-proof. ‘‘Norun that starts 
above can pass the gold stripe’’..........| 


' 
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Of the four appeals, nos. 63, 74, and 10, that are ranked much 
higher by the females than by the males, the first two are vague, 
while the third is primarily a feminine appeal, and although 
appeal no. 40, “Seamless,” is also primarily a feminine appeal it 
is nevertheless not effective in influencing women to buy seam- 
less hosiery. This statement is attested to by the fact that at 
least one manufacturer of seamless hosiery sews a thread up the 
back of his product to give them a seam-like appearance. 

In an effort to see whether brevity played a noteworthy part 
in making an appeal strong or weak, the appeals were measured 
as to length. The average number of words in the ten strong- 
est appeals for males is 4.0; for females 6.2; and the average 
number of words in the ten weakest appeals for males is 7.6; 
for females 6.5. Thus it may be noted that the strongest 
appeals on the average contain fewer words than the weaker 
ones; but while brevity may be a desirable factor in making 
appeals effective, it is not the most powerful factor in making 
for strength of an appeal; what really counts is the content of 
the appeal itself. A comparison of the content of the stronger 
appeals with the content of the weaker appeals reveals the fact 
that the main ideas embodied within the strongest appeals are 
durability, beauty, neatness, comfort; whereas there is no 
particular content in the weak appeals. They contain vague, 
irrelevant, non-persona] statements which offer uncertain 
advantages to prospective customers. 

As to the validity of the results of this study only the high 
degree of correlation between the groups tested is offered; and 
in answer to the question as to whether the ‘‘Method of Direct 
Impression” may be used to supplant or antedate the “Order of 
Merit Method” only subsequent studies, wherein the results 
obtained by the two methods may be compared, will tell. In 
one unpublished study, known to the writer, made by Prof. 
Albert T. Poffenberger of Columbia University, using seventy 
photographs, where the results of the two methods were com- 
pared the correlation was found to be almost perfect. Profes- 
sor Poffenberger and the writer also have some additional sta- 
tistical data, not yet worked up, which may throw some light 
on this question. 
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AN EXPERIMENTAL STUDY OF THE VOCATIONAL 
INTERESTS OF A LIBERAL ARTS COLLEGE 
GROUP! 


KATHRYN McHALE 


Assistant Professor of Education, Goucher College 


It is very apparent that the vocational guidance movement 
has outstripped adequate preparation for it. In many in- 
stances, regardless of where we see attempts at meeting 
the problem, we find great differences in the technique em- 
ployed to discover vocational fitness. For the most part 
however, it is being done along subjective lines. The indi- 
vidual is given authoritative information which is not only : 
description of occupations, but also an account of what the 
worker in them has to do and know; in addition, to increase 
the thoroughness of guidance various other data are used such 
as, judgments as to the individual’s fitness, academic marks (in 
a few cases, intelligence tests scores), achievement in extra- 
curricular activities, and other things of like character. Natur- 
ally, there are variations of this procedure, and a few excep- 
tions. The most admirable exceptions are found in the 
attempts made by Professor Husband of Dartmouth, and 
Professor Thurstone of the Carnegie Institute of Technology, 
to raise vocational guidance to a scientific or objective plane. 

The reason why there is so little scientific guidance is obvious 
—we need many more objective measures of vocational fitness; 
tests whose validity and reliability are sufficiently established 
for diagnosing and for predicting relative degrees of success in 
many occu nd absolute success in one, if other things 


1 The writer wishts to extend appreciation to Drs. E. L. Thorndike, 
R. Pintner, and A. L. Rogers for timely suggestions in the construction 
of the tests. 


45 
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are equal. This naturally will entail concentrated effort for a 
number of years, not only in the actual making and standardiza- 
tion of tests, but in a very detailed analytical study of what 
actual vocational success depends upon. We can say in 
general, that occupational fitness depends primarily on bodily, 
intellectual, and temperamental traits. We have many valid 
and reliable measures of the first two, but traits of either, 
however accurately measured alone, are inadequate for giving a 
complete picture of an individual. We find very few measures 
of temperamental traits, so that to appraise the value of an 
individual without trustworthy measure of his reliability, his 
honesty, his courage or his self-dependence would be unpardon- 
ably stupid. Dr. Watson (1) says we need something even 
more than this, namely, that we need to keep for vocational 
guidance purposes, scientific records of individuals from the 
one hundred and fiftieth day of their lives on. 


What objects they select day by day, what form their manipulation 
takes, and what early habits develop upon such primitive instinctive 
activity should be recorded day by day in black and white. There will 
be marked individual differences in the material selected, in the length 
of time any type of material will be utilized, and in the early habits 
which will arise . . . . but until we have followed up the future 
course ofsuch . . . . weareinno position to make generalizations 
about the original tendencies which underlie the vocations. 


Another possible determining factor which has been scarcely 
utilized for vocational guidance is the interests of individuals. 
Vocational guidance directors have sought to tap interests, to 
be sure, but few have determined accurately the degree to 
which any interest is possessed; they have not, to any degree 
of satisfaction, been able to tap accurately the interests of those 
who are not conscious, in the sense of full awareness, of a voca- 
tional interest. If we possessed full knowledge of the degree 
of existing interests we could then turn to intelligent 
study of the individual’s abilities as rel vocational 
interests. We have sufficient evidence t that if any 
individual pursues an activity in which he is wholeheartedly 
interested, he will put forth his greatest effort, which insures 
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success within his limits. The evidence can be found in a 
review of a few scientific studies of interests (2). The most 
convincing among them is that of E, L. Thorndike (3). In his 
elaboration of the Bridge’s (4) data he found the following: 


The order of a pupil’s interests as he estimates them gives almost as 
good a prophecy of the order of his abilities as he estimates them. 
Neither gives a very close prophecy because the distinctions involved 
are so fine—and because the grade received in a single course is so 
afflicted with chance error. Widen the distinction (as by comparing 
mathematics, language, physical sciences, history, drawing and music) 
and reduce the chance error (as by taking the average in four or more 
courses in each) and the correlation between interest and ability will 
surely rise considerably above 0.70. On the whole Bridge’s data seem to 
corroborate the doctrine of a very close relation between the order of an 
individual’s interests and the order of his abilities. 


These suggestions along with others influenced the writer to 
formulate a working idea to guide an objective study of voca- 
tional interests in Goucher College; the idea being, that if one 
made an information test based on interests, perhaps one would 
arrive at something more tangible by way of a guidance tool. 
The following sources served, for the most part, to furnish the 
vocabulary and test content: (a) information from books sug- 
gested by Frederick Allen (5), (b) information gathered by 
Elizabeth Kemper Adams (6) and (c) tabulated magazine and 
newspaper clippings read by Goucher students in incidental or 
casual reading for a period of three months. Several hundred 
tests of the recognition type, made up principally from these 
sources were criticized by judges who left 247 as being the most 
representative. On the cover page of the test appeared a sug- 
gested list of vocations for college women (6) with two direc- 
tions to the student, (a) to underline five of her choices in order 
of preference, (b) to read the test directions and proceed when 
the signal This test was given to 133 Goucher 
Juniors in 22, and finished in fifty minutes by the 
quickest and in ity minutes by the slowest. Samples of 
the test follow with directions. 
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Underline the word or words which will make the statement accurate 
Group I 
The most widely used individual general intelligence test in the 
elementary schools is the 
Pintner-Patterson Performance Tests 
Stanford Binet-Simon Army Alpha 
The Education Bill would if passed 
Abolish State’s Rights Provide for government inspection of 
schools Allow for school standardization Establish a 
National Department of Education with a Secretary in th 
President’s cabinet. 
Group II 
Root vegetables are best kept by 
Cutting tops Removing dirt 
Placing in water 


Seguin Form Board 


Keeping dirt and tops attached. 


The best depth of pan which will keep milk sweet longest is one 
which is 
3 5 7 9 (inches 
Tripe is a 
Fish Animal membrane Fowl Vegetable 
In reading an electric meter the dial on the right in a complete 
revolution indicates in kilowatt hours 
10 100 1,000 10,000 


A butler or waitress should start to serve 
Left of person at hostess’s left Left of person at hostess’s right 
Farthest person from the hostess Nearest person to the 
pantry 
Group II 
The ‘‘Findex System”’ is used in 
Book-keeping Stenography Filing Typewriting 
A comptometrist is secured to use principally a 
Typewriter Dictating machine Telephone Computing 
machine 


Group V 


The ‘“‘Hippocratic Oath” is taken by college graduates with an 
M.D. Ph.D. A.B. L1.B. 


The capacity of an empty stomach is 


0 1 2 3 (ounces ) 
Group VI 
A codicil is : 
An attachment A bill A supplement %6 a will A wish 
The greatest of our Chief Justices was 


Wm. White Wm. Taft John Marshall James Kent 
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In January, 1924, a questionnaire was sent to each person 
and at the same time a “follow-up letter’ to the employer. 
The results follow, but like so many other bits of psychological 


work they must be looked upon merely as a preliminary expo- 
sition of possibilities rather than as usable results. 


RESULTS 
I. Choice, consistency and influence of parental occupation 


a. The suggested vocations for women college graduates are 
shown in table 1, along with the popularity of the first and 
second choices according to this group’s selection. (The tests 
attempted to cover, in part at least, the same general vocational 
groups, with the exception of groups IV, VII, and VIII which 
were added by those who wished to vary from the suggested 
list.) 

b. Only 0.4 per cent of the group seemed to be influenced in 
choice by their fathers’ vocational pursuit, and according to the 
1924 questionnaire only 0.15 per cent pursued the same. Only 
0.3 per cent seemed to be influenced in making a second choice 
by their fathers’ vocation, and only 0.08 per cent pursued the 
same. If we consider this result then, one might be able to 
say that the father’s vocational pursuit has little, if any, influ- 
ence in determining a woman’s vocational choice. If we con- 
sider the influence of the mother’s vocational pursuit as related 
to choice we find Homemaking to be the second largest group 
represented and, in a sense, quite closely related to the first 
choice group, that is, Educational and Social Service. One 
might then state that the native tendency in the case of women 
is a most potent determiner of vocational choice, disregarding, 
of course, other possible factors such as, the reluctance to accept 
directly the pursuit of a career with money earning responsibili- 
ties, desire for a certain amount of leisure or independence, etc. 

c. The degree of stability or change of choice was revealed in 
the 1924 questionnaire when 24.8 per cent changed their first 
choice and 40.6 per cent changed their second choice. This 
perhaps reveals some truth in the traditional saying, “It is a 
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TABLE 1 





FIRST SECOND 

| CHOICE IN | CHOICE IN 
TOTAL TOTAL 

PERCENT | PERCENT 


SUGGESTED LIST OF VOCATIONS 





Group I (Educational and Social Service)* Seat | 60.0 
1. Community Service 
2. Library and Museum Work 
3. Boy’s and Girl’s Work 
. Vocational Guidance 
. Educational Research 
. Teaching 
. Rural Work 
. Protective Work 
9. Child Welfare 
10. Family Case Work 
11. Recreation 
12. Dramatics 
13. Interpreting and Translating 
14. Physical Education and Hygiene Teaching 
Group II (Homemaking, etc.)*. ae 
. Homemaking (Home E conomics, , House =hold 
Arts, etc.) 
. Dietetics and Food 
. Interior Decorating 
. Institutional Management 
. Costume Design 
Wl (Business)* 
. Civic and Government Service 
. Personnel Management 
3. Professional Secretarial Work 
. General Secretarial Work 
. Salesmanship 
. Advertising and Publicity 
. Banking 
. Publishing 
. Business 
Group IV{ 
1. Journalism 
2. Short Story Writing 


7 





* The names in parenthesis designate the general fields covered in 
those groups. 
+ Not included in the test. 





SECOND 
1OICE IN 
TOTAL 
ER CENT 


60.0 
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TABLE 1—Continued 





FIRST SECOND 
CHOICE IN | CHOICE IN 
UGGESTED LIST OF VOCATIONS 
S WEED LAST OF VOCATE TOTAL TOTAL 
PBR CENT | PERCENT 





Group V (Science, etc.)* 2 5.26 
. Medical Social Work 
. Medicine 
. Biological Work 
. Technology 
. Chemistry 
. Bacteriology 
Group VI (Law)* 
1. Law 
Group 
1. Art 
2. Architecture 
Group VIITt. 
1. Music 











woman’s privilege to change her mind.” In addition, one 
fourth would change their academic major if they had the 
opportunity. The willingness to change the academic major 
is more explainable, but both seem to emphasize the unreliabil- 
ity of choice in either case and the need for more accurate voca- 
tional and educational guidance in the selection of a vocation 
and of an academic major. 


II. Correlations 


a. The relationship between choice and the Vocational Test 
scores for all students are shown in table 2. 

These correlations are all “low” (7) ; further if the test has any 
validity, they seem to verify the results obtained above in 
relation to change of choice, namely, the undesirability of using 
choice as the reliable index of interest in guidance. In other 
words, only 24 per cent followed their first choice, 27.8 per 
cent their second, and 20.3 per cent are pursuing vocations in 
other fields not mentioned in their choices. It is also very 
probable that of all these numbers there are some who are still 
unsettled as to permanent selection. 
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b. The relationship between Intelligence (scores determined 
by the Thorndike Intelligence Examination for High School 
Seniors) and scores obtained in this vocational test for three 
groups of students follows (table 3). 

The correlations between the Vocational Test scores and 
the Intelligence Test scores for all students seem to be “low.” 
showing no relationship. The vocational test was intended 


CORRELATION 

BETWEEN CHOICE 

AND VOCATIONAL 
TEST 


TEST NAMES 


Group I (Educational and Social Service) 0.21 
Group II (Homemaking)................. —0.02 
Group III (Business) 0.17 
Group V 0.05 

0.33 


TABLE 3 





CORRELATION COEFFICIENT— 
INTELLIGENCE SCORES AND VOCATIONAL 


TEST SCORES 
NAME OF VOCATIONAL TEST 


Phi Beta | Journalism 


enema Kappas | choices 





Group (Educational and Social 
Service).................| —0.08 | 0.38 —0.: 

Group II (Homemaking, etc.)...... | 0.19 —0.04 

Group III (Business) | 0.30 0.41 

Greup V  Gebemes)..:...............4 O20 | @.99 

ee ees oe ee 


| 
| 
| 
} 





to test the ability to recognize information based on interests. 
The person therefore who has a deep interest in Law, for in- 
stance, as a probable vocation, need not necessarily be of 
superior intelligence. One deduction then is that for specific 
guidance we cannot rely upon Intelligence Tests for an unse- 
lected group. 

The correlation of the same test scores for selected groups 
show a few interesting correlations. The Phi Beta Kappa 
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sroup show “marked” (7) correlation in tests for Group I 
(Educational and Social Service) and Group III (Business). 
The group selecting Journalism as a vocational choice shows 
one “high” (7) correlation in the test for Group III (Business) 
and two “very high” (7) ones in Groups V (Science) and VI 
(law). There seems, then, to be some relationship between 
Intelligence Test scores and these Vocational Test scores in 
special groups. In addition, there were 57 per cent of those 
selecting Journalism as first choice who were above the median 
in all of these tests, while 42.8 per cent were above the median 
in all but one test; this might indicate that those selecting 
Journalism possess versatile interests. 

c. The only correlations which show any significant degree of 
relationship follow (table 4). 


TABLE 4 


ORRELATION BETWEEN 

VOCATIONAL TEST AND 

3UCCESS ESTIMATED ON 
A SCALE OF FIVE 


NAME OF TEST 


Group I (Educational and Social Service) 0.71 +0.05 
Group II (Homemaking) J, 
Group III (Business)........... 0.81 +0.09 
Group V_ (Science) 0.67 +0.07 
Group VI (Law) 





One might state then, that since three of these coefficients of 
correlation supplemented by their probable errors (i.e., a corre- 
lation should be four times its probable error) are reliable and 
“high” (and one ‘‘very high’’) that the vocational test is 
capable of predicting fairly accurately (within these limits) 
degrees of success. The number of cases included represents 
63 per cent of the original group, as 37 per cent are not pursuing 
paid vocations. There is no correlation for Homemaking as 
we did not take the estimates of success made by husbands 
seriously, first, because they, no doubt, would have been 
prejudiced by new factors, and second, because they probably 
would not have analyzed homemaking into its recognized 
components. No one is pursuing Law (the only other test for 
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which we have no correlation), in fact or in study, and no one js 
pursuing Art, Architecture or Music, mentioned by a few a 
their desired choices. 

If degrees of interests are indicative of success it would seem 
that this test has some degree of validity which is a little more 
objective than (a) choices as the individual selects and holds to 
them, and (6) general intelligence tests as used for specific 
vocational guidance. If then, this kind of a test were enlarged 


8 


to include all vocations and its validity as well as reliabili 
proven within the desired limits, one could then use it as a 


¢ 
+1, 


substitute for many things used in present guidance. Present 
ce 


in the condition in Which students 
of temperature were before the discovery of the thermometer, 


vocational guidance is 


or any other scale for measuring temperature.” For the most 
part vocational guidance directors up to the present time have 
been interested in organization and have about completed that 
phase of it, at least in theory if not in fact. The next logical 
step is to find some objective procedure that will suit the time 
at present available for guidance, the present vocational guid- 
ance staff, and the great numbers demanding guidance. This 
challenge is becoming most imperative. 
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NOTES AND NEWS 
SPECIAL CLASSES FOR FEEBLE MINDED AND SUB-NORMAL CHILDREN 


Enrollment in schools and classes for feeble minded and sub-normal 
children in this country shows an extraordinary increase in the past 
twenty-two years, according to a report made public today by the 
Department of the Interior through the Bureau of Education. This 
increase does not show that a greater percentage of children are be- 
coming mentally defective from year to year, but it indicates a growing 
interest on the part of cities, States, and private organizations in 
making provisions for this unfortunate class. 

In 1900 the 29 schools reported had 10,217 inmates. Although city 
schools were not reported separately, it appears that there were then 
very few city classes for defectives. In 1918, 206 schools reported 55,- 
084 pupils The 214 schools in 1922 reported a total of 63,399 pupils. 
The enrollment has increased 15 per cent during four years. This is 
more than twice as much as the increase in enrollment in public ele 
mentary and secondary schools during the same time. 

Three types of school for the mentally defective are shown in the 


report, viz., State institutions, private institutions, and city day 
schools. About one-half of the total number, or 133, are classes in 
city day schools, 51 are State institutions, and 30 are private institu- 
tions. 


The principal increase in number of pupils has been in city day 
schools, which enrolled 18,133 in 1918 and 23,253 in 1922, an increase 
of 5149. The increase in the city schools shows a tendency on the part 
of local authorities to take care of local situations, in this way to doa 
great service to the child in keeping him with his parents, and at the 
same time to relieve the regular school teachers of a responsibility 
which should not be expected of them. 

Total receipts of State institutions reporting for the year 1921- 
1922 amounted to $14,911,234. The expenditures for buildings and 
lasting improvements, teachers’ salaries, books, etc., and current ex- 
penses, were $13,315,370. The total receipts of private institutions 
for the same period were $727,143, and the expenditures were $719,263. 
State institutions reported property with a total value of $45,821,771. 
The value of property of private institutions amounted to $1,460,862 

A bulletin containing a detailed statement on these subjects has 
been issued by the Commissioner of Education of the Interior Depart- 
ment. 
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THE BRITISH ASSOCIATION FOR THE ADVANCEMENT OF SCIENCE 


The British Association for the Advancement of Science, while 
resembling the American Association for the Advancement of Science, 
nevertheless differs from it in certain particulars. 

“The objects of the British Association are: To give a stronger 
impulse and a more systematic direction to scientific enquiry; to pro- 
mote the intercourse of those who cultivate science in different parts 
of the British Empire with one another and with foreign Philosophers, 
to obtain more general attention for the objects of science and the 
removal of any disadvantages of a public kind which impede its prog- 
ress.” 

The Association, which was founded in 1831, meets annually for 
one week or longer at important centres, other than London, in Eng- 
land, and it occasionally meets in other parts of the British Empire. 

The Association has met in Canada on three previous occasions, 
viz., in 1884, 1897 and 1909. Other overseas meetings have been held 
once each in South Africa 1905 and Australia 1914. 

The average attendance at annual meetings of the Association for 
the eighty-three years previous to 1920 was 2330. The Toronto meet- 
ing affords an exceptional opportunity for intercourse between British, 
Canadian, American and European workers in Science. 

A preliminary programme will be forwarded on application to the 
Local Secretary, British Association, Physics Building, University, 


Toronto, and those who intend to be present at the meeting are par- 


ticularly requested to apply for this as soon as possible. 

No technical qualification is required on the part of an applicant 
for admission as a member of the Association nor is there any limita- 
tion in respect of nationality. 

The form of membership of most interest to Americans and Canadi- 
ans, who are very cordially invited to join for 1924, is that of annual 
member. t 

Payment of $7.50 made before or at the meeting entitles the annual 
member to attend the meeting and to receive the report. Payment 
of $5.00 entitles the member to attend the annual meeting and the 
membership ticket admits the holder to any of the sectional meetings 
and to the various popular lectures, receptions, local excursions, etc., 
which are features of the meeting. 

Membership tickets for the meeting may be obtained from the 
local Hon. Treasurer, British Association, Room 50, Physics Building, 
University, Toronto; cheques should be made payable to the British 
Association for the Advancement of Science. 

Arrangements are being made with the Railway Companies for 
reduced rates on the return fares of those who hold membership cards. 

Hotel accommodation should be reserved in advance of the date of 
the meeting. 
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Scientific meetings 


The Inaugural General Meeting will be held on Wednesday, August 
6, when Major-General Sir David Bruce, K.C.B., F.R.S., will assume 
the Presidency of the Association in succession to Professor Sir Ernest 
Rutherford, F.R.S., and will deliver the Presidential Address. 

The Association is organised in thirteen sections, those of chief 
interest to readers of this journal being: Economic Science and Stati 
tics, Sir William Ashley; Anthropology, Dr. F. C. 8. Shrubsall; Physi- 
ology, Dr. H. H. Dale, C.B.E., F.R.8.; Psychology, Prof. W. McDou- 
gall, F.R.S.; Educational Science, Principal Ernest Barker. 

Addresses will be delivered by the Sectional Presidents of the res- 
pective sections and papers will be read on and after Thursday, August 
7, until the conclusion of the meeting. 

Joint meetings of various sections will be held also at which the 
following are among the subjects to be discussed: Sections B and | 
Vitamines and the relation of light to their action; Sections I and J, 
Physiological and psychological factors of muscular efficiency in in- 
dustry; Sections J and L, Tests for scholarship and promotion; Sec- 
tions H and J, Racial mental differences. 

During the week of the meetings a number of popular lectures will 
be delivered by prominent visitors. Among the titles which have 
been announced are: ‘‘Human Heredity and National (or racial) Out- 
look,’’ by Professor W. McDougall, M.B., F R.S.; “Seeing is Beliey- 
ing,’’ by Professor E. P. Cathcart, M.D., F.R.S.; ‘“‘ Voice Production’”’ 
by Sir Richard Paget; ‘‘The Importance of the Infinitely Small in 
Nutrition,’’ by Professor J. C. Drummond D. Sc. 

A lecture to the Workers Educational Association will be delivered 
by Professor R. H. Tawney of Oxford University. 

The subject of the Presidential Address by Sir David Bruce will 
be “‘Advances made in our knowledge of disease (with special refer- 
ence to methods developed during the war).”’ 

Additional information will be gladly supplied by the Local Sec- 
retary, British Association, Room 50, Physics Building, University, 
Toronto, Canada. 


Summary of Programme of Section L—Education May 8, 1924 


The President’s address will be delivered by Ernest Barker M.A., 
D.Litt., LL.D., Principal of King’s College, London, well known for 
his writings on pdlitical history and thought, who will speak on the 
subject ‘‘The Nature and Conditions of Academic Freedom in Uni- 
versities. ”’ 

The programme in brief is: 
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General. ‘‘Teaching of the History and Geography of the British 
Empire,’’ by Professor Wrong, Toronto. 

“Modern Tendencies in Geography Teaching,’’ by E. Young 
F.R.G.S., Secy. Middlesex Education Committee. 

“tnterchange of Teachers between Different Branches of Educa- 
tion,’’ by Prof. P. T. Nunn, Principal London Training College. 

‘Modern Developments in Method and Scope of Adult Education, ”’ 
by Dr. Heath. 

‘“Modern Developments in Science Teaching,’’ by Mr. C. N. Ste- 
wart. 

“The Place of Classics in a Secondary School Education,’ by 
Mr. Legge. 

“The Canadian University,’’ by Sir Robert Falconer. 

“An Educational Experiment in Rural Saskatchewan,’’ by Prof. 
G. M. Weir, University of British Columbia. 

“The Adolescent Education Act in Ontario,’? by Major J. P. 
Cowles. 

“Selection of Pupils for Auxiliary Classes,’’ by Dr. S. B. Sinclair 

“Educational Administration in Canada,’’ by Rev. Canon Cody 
(late Minister of Education for Ontario). 

“The Psychologist and the Education Committee,’’ by Dr. Cyril 
Burt, London County Council Education Department. 

“The new Curriculum for French Secondary Schools,’’ by Mr. 
A. H. Hope. 

Joint Sectional Sessions. With Psychology Section. 

“The Use ot Partial Coefficients of Correlation in Educational 
Research,’’ by Messrs. Sandiford, Brennand and Holmes, To- 
ronto. 

“Tests for Scholarship and Promotion,’’ by Dr. Cyril Burt. 

“The Training of Pupils Intended for an Overseas Life.’’ 

Popular Lectures. 

“Sense of Humourtin Children,’’ by Dr. Charles Kimmins M.A., 
Chief Inspector of the Education Department, London County 
Council. 

“Voice Production,’ 


’ 


by Sir Richard Paget. 


BUREAU OF EDUCATIONAL AND VOCATIONAL GUIDANCE 


The University of North Carolina has established, under the direction 
of the Department of Psychology, a bureau for the investigation of 
methods for promoting the educational adjustments of its students, and 
for psychological guidance in the choice of vocations and in adaptation 
to the various phases of student life. The maior problems which are to 
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be undertaken by this bureau are the assembling of a complete biblj- 
ography upon various phases of vocational and personnel work, the 
collecting and administering of available tests for the measurement 
of mental and vocational aptitudes, the administration of tests of intelli- 
gence and other traits to freshmen, and the working out of an adminis- 
trative technique whereby the results of such tests may be made effec- 
tive in the organization of college work, the development through 
research of a suitable group scale for the measurement of fundamental 
personality traits, the promotion of mental hygiene among students by 
general methods and more particularly by the individual treatment of 
students whose work is handicapped by emotional conflicts and other 
nervous conditions. The work at North Carolina is still in its infancy 
but it is hoped that progress will be made toward supplying at this 
university a need which is now realized by many educational institu- 
tions. The purpose of this notice is to enlist the advice and coéperation 
of similar personnel organizations throughout the country. Address: 
The Bureau of Personnel Research, Department of Psychology, Univer- 
sity of North Carolina, Chapel Hill, N. C. 
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A. J. Snow. Problems in Psychology. Henry Holt and Company, 
New York, 1923. 

In this small volume the author has collected approximately one 
thousand problems related to the major aspects of psychology. The 
author states that no attempt has been made to select the problems with 
the thought of developing a single psychological point of view. On 
the contrary care has been taken to direct the student’s attention to 
different points of view. The problems are grouped into seventeen 
sections. The first sixteen of these bear chapter headings usually 
found in modern books on psychology. The last chapter containing 
two hundred and ten questions relates to the different fields of psy- 
chology, including animal, social, and general psychology. 

Good problems are always valuable in teaching any subject but are 
not always ready when the occasion demands. This collection of 
problems will tend to supply this deficiency and materially aid in 
making the teaching of psychology more concrete. In doing this, it 
will serve a definite pedagogical purpose. The Problems in Psychology 
will be found to be a valuable supplement to the text-book and refer- 
ences in any course in psychology. 


Witt1aAM Srms ALLEN, Pu.D. A Study in Latin Prognosis. Teachers 
College, Columbia University, Contributions to Education, No. 
135. New York City, 1923. 

The author of this monograph attempts to show to what extent 
success in Latin can bé predicted by the use of certain standardized 
tests. As a basis for his conclusions the author studied the success 
in Latin of three hundred and sixty-four boys electing this subject 
in the Boys’ High School, Brooklyn. They were divided into eleven 
classes taught by four teachers. The class grouping was based on 
the results of the Otis Group Intelligence Scale given in June before 
entering High School in September. 

For the purpose of selecting a test or a group of tests that would 
have prognosis value, twenty some different tests were given at the 
opening of school in September. The list of tests follows (page 3): 


1. Briggs Analogies Test Alpha 
2. Briggs Analogies Test Beta 
3. Thorndike-McCall Reading Scale Form 3 
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4. Thorndike-McCall Reading Scale Form 4 
5. Kelley-Trabue Completion Test A!pha 
. Kelley-Trabue Completion Test Beta 
. Thorndike Test of Word Knowledge Form A 
3. Thorndike Test of Word Knowledge Form B 
. Thorndike Non-Language Test Forms IA, IL, IIB 
. Terman Group Test of Mental Ability Form A 
. Terman Group Test of Mental Ability Form B 
2. Rogers Test of Mathematical Ability 
. Free Association Test 
. Wylie Opposites Test A 
Wylie Opposites Test B 
16. Wylie Opposites Test C 
17. Wylie Opposites Test D 
18. Wylie Opposites Test f 
19. Wylie Opposites Test | 
20. Wylie Opposites Test r 
21. Wylie Opposites Test t 


It will be seen that the author in selecting the prognosis tests made 
extensive use of those that measure language ability in its various 
phases. 

At the close of the first semester eleven pairs of Latin tests were 
given. Professor Briggs in devising these Latin tests sought to isolate 


and measure the different phases of Latin taught during the first semes- 
ter. The list of these tests follows (page 7): 


1. Syllabification Tests Alpha and Beta 
2. Gender Tests Alpha and Beta 
. Nouns Alpha and Beta 
. Pronouns Alpha und Beta 
. Conjugation Alpha and Beta 
. Vocabulary Alpha and Beta 
. Derivation Alpha and Beta 
. Construction Alpha and Beta 
9. Pronunciation Alpha and Beta 
10. Translation: English to Latin Alpha and Beta 
11. Translation: Latin to English Alpha and Beta 


The results of these tests were tabulated and given the usual statis- 
tical treatment and yield three prognosis tests with high reliability 
and fair predictive power. 

The first prognosis test is composed of Briggs Analogies Alpha, 
Thorndike Test of Word Knowledge A, and Rogers Interpolation 2. 
The test requires thirty-five minutes to administer and yields results 
with a reliability of 0.880 and gives a prediction of 0.559. 
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The second test is composed of Briggs Analogies Beta, Thorndike 
Test of Word Knowledge B, and Rogers Interpolation I. This test 
also requires thirty-five minutes to administer and yields results with 
a reliability of 0.880 and gives a prediction of 0.578. 

The third test consists of prognosis tests 1 and 2, and requires sev- 
enty minutes to administer with a reliability of 0.936 and gives a pre- 
diction of 0.588. P 

The results also indicate that the same groups of tests predict Eng- 
lish and Mathematics success almost as well as they predict Latin 
success. It should be noted that the author does not recommend the 
exclusive use of these tests in admitting and excluding pupils. In the 
case of Latin other means should be used, including various school 
records, teachers’ marks, teachers’ estimates, and personal confer- 


ences. 

Such studies as this one are valuable not only for specific facts 
pointed out but as a method of approach to one of our perplexing 
problems. 


PercivAL Matton Symonps, Px.D. Special Disability in Algebra. 
Teachers College, Columbia University, Contributions to Educa- 
tion, No. 182. New York City, 1923. 

In this study Professor Symonds has given his attention to a special 
disability—disability in Algebra. The monograph is divided into nine 
chapters. He has also appended a selected bibliography of fifty-eight 
titles. The scope of the study can best be presented by a statement 
of the subject of the several chapters. 

Chapter I presents the problem of special disability and suggests 
methods of study. In Chapter II there is a discussion of individual 
differences in Algebra as indicated by the results obtained from the 
use of tests by Hotz and Rogers. 

Chapter III describes the results of a careful study of twenty-two 
pupils selected because of their special disability in Algebra. 

In Chapter IV we find descriptions of the peculiar mathematical 
disabilities of several of the cases selected for study in Chapter III. 

In Chapter V and VI methods for correcting coefficients of correla- 
tions for attenuation and selection are developed. 

Chapter VII makes corrections of coefficients of correlation reported 
by different investigators. The methods used in making these cor- 
rections are those outlined in Chapters V and VI. 

In Chapter VIII we find the author’s attempt to interpret the cor- 
rected correlations of Chapter VII as an agency in determining the 
amount and frequency of special disability in Algebra. 

In the last Chapter the practical conclusions for school purposes 
are summarized. 

Certain facts brought out by the study are of interest to students 
of applied psychology. 
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1. It seems clear that the last three months of school-year in al- 
gebra is only a fraction as profitable for the modal pupil as the first 
three months. The student has ceased to learn or he is learning some- 
thing that can not be measured in the ordinary manner 

2. There is a genuine increase in variability of distribution toward 
the close of the year. This perhaps indicates that some pupils con- 
tinue to learn even at the end of the year, while others stopped learn- 
ing before reaching the end of the year. 

3. The study of the twenty-two cases of special mathematic#dis- 
ability warrants the conclusion that ‘‘Those who have special dis- 
ability in mathematics are not deficient in working with the other 
materials with which intelligence deals.’’ Even disability in Algebra 
does not signify disability in geometry. There is evidence to indicate 
that special disability in mathematics is due to material or content 
and not form {page 27). 

After correcting coefficients of correlation between Algebra and 
other studies the author reports the following summary: 


Algebra correlates with geometry, English and intelligence. 


UNSELECTED HIGH SCHOOL 
POPULATION FRESHMAN 


Geometry 0.82 0.73 
English 0.76 0.6: 


Intelligence 0.89 


On the subject of the frequency and amount of special disability the 
author concludes that “high intelligence means good ability in Al- 
gebra and low intelligence means poor ability in Algebra.”’ “Of the 
twenty-two brightest pupils out of the hundred seventeen will be above 
the average in Algebra, and of the twenty-two stupidest pupils seventeen 
will be below the average in Algebra.’’ 

The author does not undertake to say who should study Algebra. 
The answer to the question must in the main depend on other than 
psychological considerations. Psychology has made its chief contri- 
bution when it predicts algebraic ability. This, the author believes, 
can be done by the use of intelligence tests since there appears to be a 
high correlation between success in Algebra and intelligence. An 
understanding of special disability in Algebra will aid in considering 
courses of study, ,text-books, class assignments, and class periods. 

While the study has limitations, on the whole it is a valuable con- 
tribution to education and should stimulate similar studies in other 
subjects. 
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FrANK N. FREEMAN AND Mary L. Dovucuerty. How to Teach Hand- 
writing. Houghton Mifflin Company, Riverside Press, Cambridge, 
Mass., 1923. 

In How to Teach Handwriting the authors have made an excellent 
and timely contribution to our pedagogical literature. Too long have 
we waited for such a treatment of this subject. In this volume we 
hayg a teacher’s manual of handwriting that ig scientific as well as 
; The authors have. been guided in the preparation of the 
Manual by the well established principles of handwriting resulting 
from the careful experimental studies of Professor Freeman. The re- 
sults of his investigations have been fully described in his monograph 
entitled The Handwriting Movement. 

As the title indicates it is a volume that will serve the needs of the 
class-room teacher as well as the supervisor of writing. The first 
thirty-four pages give a brief summary of the most important principles 
fundamental in learning to write. The major portion of the book 
gives details for conducting lessons in the subject. Much attention 
has been given to the selecting and arranging the exercises. As a 
result of this we have the course in writing for the first six grades out- 
lined in detail. Definite goals for each stage of the six-year course 
have been determined, thus making it possible for the instruction in 
handwriting to go forward in a consistent and pedagogical manner. 

The authors have in this Manual attempted to dispel two illusions 
that have had more or less influence on the teaching of handwriting. 
In the first place they have attempted to make it clear to those in- 
terested that satisfactory writing can not as a rule be left to chance 
and to incidental teaching of the subject. In the second place they 
have shown that the teaching of handwriting is not surrounded with 
mystery and difficulties which can be mastered only by a few especially 
endowed. In their treatment of the subject they point out that here 
we have a subject the learning of which follows certain fundamental 
principles that may bé applied by the class-room teacher. This Manual 
will do much to clarify the writing situation in our schools, and to 
place the teaching of this fundamental tool of learning on a sane and 
scientific basis. 

Wixuis L. Garp, 
Ohio University. 


J.E.W. Wauuin. The Diagnostic Findings from Seven Years of Examin- 
ing in the Same School Clinic. Miami University. 

This is a summary of the diagnostic findings of seven years’ work 
in the St. Louis Psycho-Educational Clinic. Dr. Wallin says that no 
similar summary of diagnostic findings from a similar clinic for an 
equal period of time has ever been published before. In this study 
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Dr. Wallin finds a lower percent of feebleminded in the elementary 
schools of the St. Louis Public Schools than is believed by other work- 
ers in the field of clinical psychology. However, Dr. Wallin does not 
define what he means by the term “Feebleminded.’’ He possibly is 
not including the higher types of mentally deficient people. Dr. Wal 
lin states that the lower classes are not included in his percent. He 
stresses that every large school system must have, in addition to the 
special schools for feebleminded, a much larger number of ungraded 
classes for children who, while not feebleminded, are so backward 
either in intellectual or pedagogical status as to require individual 
instruction or a differentiated course of study. He says that as a 
result of this study that the number of pupils assigned to special classes 
should vary from 1 to 5 per cent of the elementary school population. 

Considerable discussion and data are given on different types of 
mentally deficients such as the mongolians, cretins, epileptics, hydro- 
cephalics, amaurotics, psychopaths, speech defectives, neurotics and 
delinquent children. He found nine times as many speech defectives 
among the special class children as he found in the total population 
of elementary pupils. This seems to show us that speech defect is a 
mental condition. Dr. Wallin says, in speaking of psychopathic chil- 
dren, that their conduct had changed from one of disorder to order after 
being placed in special classes. 

The data contained in this pamphlet and the descriptions given 
are of highest value to educators interested in carrying out a complete 
school system. 

La Vinta WARNER, 
Ohio University. 


Wa trter Dit Scorr anp RoBerTC. Cioruier. Personnel Management, 
Principles, Practises and Point of View. A. W. Shaw Co., 1923. 
Pp. xxii, 643. 

The new ‘“‘science in management’’ has now provided a manual of 
procedures and practises and a systematic point of view on the subject 
of individual human adjustments in industry. The volume crystalizes, 
in its application to industry, the experience of the Committee on 
Personnel in the Army and the work of the Scott Company in coéperat- 
ing with more than forty industrial and business concerns. The 
scientific background of President Scott, his contact with the personnel 
research bureaus at the Carnegie Institute of Technology and with the 
direction of classification of men in the army, Mr. Clothier’s practical 
experience as employment manager of the Curtis Publishing Company 
and the accomplishments of the groups of men working with them have 
been ably organized into a systematic and consistent whole. Applicd 
psychology is now able to stop and look about to see the personnel move- 
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ment in perspective, to ask what may have been neglected and what 
should be the next step. 

The central idea from this stereoscopic view formulated by Scott and 
Clothier is the scientific study of the man-in-his-work for the purpose of 
both increasing the efficiency of production and the happiness of the 
worker through better adjustment of industry to individual differences. 
As the authors say, it is no longer the square peg in the round hole for 
both the man and the job are regarded as modifiable, changing, develop- 
ing. The worker is not a machine, still less a commodity, but a human 
organism which is to be adapted to variable work opportunities. 

This splendid contribution of a systematic viewpoint should lead no 
reader to classify the book as theoretical. Nine-tenths of the content is 
taken up with descriptions of specific instruments for facilitating human 
adjustments and careful directions as to how the methods are to be 
introduced and codrdinated. The descriptions of the methods are 
accompanied by examples of their use in practise. The officers of any 
concern as well as those professionally interested in personnel work can 
thus obtain a comprehensive idea of the functions of a personnel depart- 
ment and detailed information of methods for the personal adjustment 
of a worker-in-his-work. The authors have chosen to describe one 
selected complete series of methods as worked out by their group of con- 
sultants, rather than to set forth the variety of forms of each method. 
The result is a thorough occupational description of the work of a per- 
sonnel department as they see it. Approved practises are set forth for 
reaching the source of labor supply, occupational descriptions, appli- 
cation blanks, testing qualification cards, rating scales, promotional 
charts, training, personnel control charts, the introduction of the worker 
to his work, supervision and follow-up, incentives, procedure in making 
adjustments, and the use of personnel instruments in control of salary 
and of labor turn-over. Four appendices show the development of the 
graphic rating scale, of a plan for apprentice training, a summary of the 
literature on labor turnover and samples of reports after personnel 
surveys. The bibliographies throughout are excellent. 

The Personnel Department is ‘‘principally a staff department,” 
acting as ‘‘a connecting link between the officers who determine the 
personnel policies of an organization and the departmental executives 
whose duty it is to execute those policies.”” The description of staff 
and line functions is manifestly influenced by the organization of 
personnel work in the army. In the form of the instruments also, it is 
clear that the experience with the army has been highly valued. The 
methods, however, have been adapted to industrial conditions and have 
been tried out to show their usefulness. Even a concern with the most 
democratic organization of its employees instead of tne common army 
type of responsibility, will need these personnel instruments for making 
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individual adjustments. The authors are confident that their ‘‘science 
in management”’ is widely different from “scientific management’’ as 
operated in the average plant. Their view stresses the fairer distri- 
bution of happiness among the workers as well as greater efficiency, 
They point out that labor has supported the work of the Personne] 
Research Federation and is not opposed to that scientific study of human 
relations which has sufficient regard for justice to the workers. 

By leaving the determination of labor policies to company officers 
outside the personnel department, and by omitting all discussion of 
shop councils, labor organizations, collective bargaining, etc., it is clear 
that the authors have taken a distinctive point of view towards the 
functions of personnel administration. It might be characterized as 
an endeavor to stick to the strictly psychological problem of adjusting 
individuals and their work. It may even be the hope of the authors 
that this plan offers the best solution of the clash between organized 
groups of employers andemployees. At any rate it is a distinctly differ- 
ent conception of personnel management from that commonly found in 
books on personnel administration. The problems of group psychology 
are obviously omitted. The authors wisely do not attempt to cover all 
questions connected with the human factor in industry. The book 
contrasts also with the contents and viewpoint of such a book as Myer’s 
Mind and Work which s 1e background for English movement to 
establish an independent institute of psychology and physiology to 
scientifically investigate the human problems of unrest in industry. 
The usefulness of psychology to industry is clearly not limited to prob- 
lems of individual adjustment, although here Scott and Clothier have 
demonstrated that it has quickly advanced far in technique and assur- 
ance of success. 

The final chapter on Research is almost a classic in its brief and 
vigorous statement of prevalent attitudes of industrial and business 
executives which make it difficult for them tc acquire a scientific atti- 
tude toward their personnel problems. To the alert and far-seeing 
executive, scientific personnel study affords not only a promise of high 
reward to his concern but also the means for it to attack the ‘“‘diseased’”’ 
industrialism of which Carleton Parker warned, and to meet its obliga- 
tion to work toward greater social justice as well as against economic 
waste. Such industrial leaders should be inspired by this spot-light 
which shows clearly one road up which to advance. 

In this early stage of the science of personnel, applied psychologists 
can hardly be blamed if they treat this highly authoritative book 
almost as if it were-written on tablets of stone. 

J. B. Miner, 
University of Kentucky. 
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DANIEL ALFRED Prescott, Ed.D. Psycho-Educational Clinic, Harvard 
University. The Determination of Anatomical Age in School Child- 
ren and Its Relation to Mental Development. Harvard Monographs 
in Education. Whole No. 5, Series 1, No. 5. Cambridge, Mass. 
The Graduate School of Education, Harvard University. July, 
1923. 

This interesting study is based on the measyrements of radiographs 
of three thousand children. Its purpose is to establish norms of ana- 
tomical development and to measure the deviations of certain 
individuals from these norms and from the norms for mental develop- 
ment, with a view of finding out something of the relationship between 
physical growth and mental development. This should be of interest 
to educators, to those interested in athletics and also to students of 
child study. The anatomy of the wrist was taken as the index for this 
study and X-ray pictures were taken of the wrists of both boys and 
girls. 

Extended references were made to Mr. Rotch, also Mr. Smith of the 
United States Naval Academy, and Mr. Woodrow and Lowell and others. 
Children from six years on up into adolescence and some adults were 
included in the study. Both normal and feebleminded individuals are 
included. A chapter is given to the description of the apparatus and the 
method used in finding these measurements. 

It was found through this study that the mentally deficient are also 
retarded anatomically, that is, the mental deficients were discovered to 
be lacking in a well rounded, complete development. It was discovered 
that girls are about eighteen months ahead of. boys throughout the 
whole period of growth, from six to maturity. 

A chapter is given to case study which is very interesting to the stu- 
dent of mental, physical and anatomical growth of children. 


M. La Vinia WARNER, 
Ohio University. 


Litutien J. Martin. Mental Training for the Pre-School Age Child. 
Harr Wagner Publishing Co., San Francisco, 1923. 100 pp. 

Following a brief foreword this little book consists of I, a Mental 
Hygiene Questionnaire; II, discussion of a child’s training from the 
standpoint of heredity, physical and psychological examination, inter- 
action of the mental and physical, imitation, habit making and breaking, 
emotional development and control, incentives to action, dependence 
versus independence, responsive versus resistent attitude, environ- 
ment, storing the subconscious, play, delinquent tendencies, punish- 
ment and sympathy; and III, the Education of the Parents. 

Part I gives a list of seventeen questions to which answers are secured 
from mothers whose children Dr. Martin examines. This is a valuable 
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list of questions not only for all parents but for all teachers responsible 
for the training and educating of growing children. While not an ex- 
haustive list of all questions which might be asked, it is very complete 
because directed at the vital sources of life’s fundamental driving and 
directing forces. In Part II the content of each of these questions 
is transformed into a positive constructive statement called a rule. 
After a brief, well chosen discussion and explanation of each of these 17 
rules, the histories of several children are given in sufficient detail, but 
not tedious, to show specifically how the rule applies in solving problems 
of individual children. This gives value and vividness to the theory 
brought out in the discussion and makes the entire book very readable 
and practical. 

Part III is very brief. In it the responsibilities of parenthood are 
emphasized. 

This book gives simple directions for the training of young children 
upon a scientific basis. Such training when intelligently given is hu- 
mane beyond comparison with any other method. It is so simple and 
practical that no parent or teacher can help but learn much from study- 
ing it. 

Herman H. Youna, 
Indiana University. 


EpGar DuNNINGTON RanpotpH. The Professional Treatment of Sub- 
ject-Matter. Baltimore, Warwick and York, 1924. Pp. 202. $2.20. 
The author brings to this study a rich background of experience in 
the public schools, in normal schools, in a liberal-arts college, in a 
teachers college, and more recently in a department of education in a 
great western university. The interest centers in the problem: Should 
instruction in subject-matter in a teachers college be differentiated from 
that given in the same field in schools of general education? In other 
words, does the responsibility of the teacher of teachers in a given sub- 
ject differ from that of a teacher of the same subject in a liberal-arts 
college? Through a discussion of the development of the idea of the 
professional treatment of subject-matter and a consideration of the 
present conditions of that interest, the specific needs of teacher-training 
are presented (1) as to the needs of teachers—‘“‘scholarship, technique, 
and professional intelligence,’’ and (2) as to the work of teacher-training 
institutions—the character of the organization of instruction, the more 
significant phases of faculty organization, and certain details of the 
administration practice. By comparison and contrast, the author 
points out, through the discussion of the functioning of the liberal-arts 
college, the so-called academic normal school, and the purely profes- 
sional normal school, the achievements and the failures of teacher-train- 
ing. Among the latter, there is mentioned ‘“‘the peculiar field of the 
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professional purpose,—the conscious adaptation of instruction to the 
characteristic responsibilities of public-school teachers and to the 
typical pressures of their occupations on them.’’ The conclusion is 
that the achievement in the professionalization of subject-matter has 
depended upon the professional attitude of teachers of teachers in 
professional schools; and by the term “professional attitude” is meant 
that “the teacher of teachers shall be so sensitive to the needs of the 
service and so well acquainted with the characteristic pressures upon the 
public school teacher that he will consciously shape his instruction in the 
interest of both.’’ In the fourth and last chapter, ‘““‘Some Suggested 
Applications,’’ an attempt is made to exemplify ‘‘professionalized’”’ work 
in geography, literature, and arithmetic, as ‘‘a teachers college would 
feel bound to illuminate the topics covered in the public school courses 
of study in its tributary region, and to transcend the treatment given 
in the best elementary school textbooks.” 

Criteria for appraising this monograph are not offered in a preface. 
After his ‘‘Acknowledgements,’’ the author proceeds to state the prob- 
lem and to make an interpretative analysis of relevant historical 
materials. The ten pages of bibliographical notes include materials 
from a wide range of sources and indicate that the scattered literature 
on the subject has been carefully assembled. The author, who exhibits 
the qualities of scholarship and ‘‘subtle knowledge”’ which he insists are 
essentia! to the successful professional teacher, has arranged his mate- 
rials to demonstrate that professionalizing academic materials has been 
the work of the normal schools; and, in these, only sporadic instances 
appear. The illustrative materials, calculated to demonstrate princi- 
ples established in the three earlier chapters, admirably convey the 
professional ideals of scholarship and method. To the student of this 
pertinent problem in teacher-training, this work appears as a unique 
contribution, which should pave the way for efforts to professionalize 
subject-matter not only in the professional schools but also in the 
specialized departmehtal work of other institutions. 


Epwin B. Sirus, 
Ohio University. 


FreDERIC LyMAN WELLS. Pleasure and Behavior. D. Appleton and 
Co., New York, 1924. Pp. 274. 

If one wishes to study the psychology of pleasure this book will form 
an interesting introduction. It is to be remembered that it is the 
psychology of pleasure and not of happiness that is the subject of the 
work though the author consistently confuses the two; and perhaps 
deliberately. 

The book is strongly influenced by psycho-analytic concepts and 
takes the ‘‘tough-minded”’ attitude generally. It deals chiefly with 





272 BOOK REVIEWS 


instincts and ‘‘urges’’ as in a discussion of ‘“‘pleasure’’ it should. The 
author expresses his view that everyone is working for his own pocket 
all the time—‘‘just the same (gentle reader) as you are,’’ without ade- 
quate recognition of the fact that the gentle reader in working for his 
own pocket is also working for his author’s pocket; and doing so 
consciously and heartily. 

It is a difficult task that the book essays: to present the foundations 
and growth of the affective life of the individual in its natural and human 
settings. This involves constant reference to history, anthropology, 
ethics, physiology and other sciences. It is not strange that exception 
may be taken to many of the statements in such a composite. And yet 
for a complete account these and other detailed studies of man are 
necessary. The problem is in large part one of synthesis. The ethical 
thinker should be grateful for this pleasant and happy presentation of 
many important facts. Ir regard to their synthesis and interpretation 
he may still hold reserva’ ivas. 


Harry CurIsTOPHER Humpureys, Pu.D. The Factors Operating in the 
Location of State Normal Schools. Teachers College, Columbia 
University Contributions to Education, No. 142. New York City, 
1923. Pp. 152. 

This is a valuable study of an important subject; but the title 
promises both more and less than the study includes. The book deals 


with the political factor in the location of the normal schools in four 
states; and with other factors, such as donations from cities or the dis- 
tribution of existing schools in some eight or ten states. It should be 
said that there is an appendix composed of excerpts from the laws deal- 
ing with the establishment of state normal schools in forty-three states. 
The study clearly shows the presence and the potency of unworthy 
determinants of the location of our state normal schools. 

What is really a second study not indicated in the title of the book 
is found in Chapter V. This chapter is entitled: ‘‘A Comparative 
Study of State Normal Schools in Selected States.’’ Four contiguous 
eastern and one southwestern state are studied, chiefly with regard to 
the student enrollment and distribution of their state normal school 
population. This is a significant study and of course bears upon the 
wisdom of the present locations of the schools in the selected states. 
But there is no attempt to compare the educational standards, faculties 
and general effectiveness of the schools themselves. Yet such matters 
must surely affect,the enrollment and distribution of the students; so 
also must, for example, the age of the school, its advertising policy and 
the strategy and loyalty of its alumni. 

The study eventuates in a theoretical technique for the location or 
re-location of state normal schools and in several entirely defensible 
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recommendations. While not a definitive treatment this is a worthy 
beginning of a thorny subject. Some day the location and re-location 
of state and private universities may be studied. What slight and even 
ridiculous factors have determined locations may be seen, for example, 
in the case of Cornell, in the autobiography of President White. 


WatterR S. Monrog anv Luoyp B. Soupers. The Present Status 
of Written Examinations and Suggestions for their Improvement. 
Bureau of Educational Research, College of Education, University 
of Illinois, 1923. Bulletin No. 17. Pp. 77. Price 50 cents. 

This very excellent bulletin is just what its title indicates. It is both 
informing and suggestive. It contains important original studies. It 
should be carefully read by all teachers. And while none should neglect 
to ponder, the more urballasted members of the profession should 
especially try to discover the meaning of the perfectly indispensable 
reservations tucked into two paragraphs on pages 61 and 62. By and by 
the newer type of written examinations will find their proper place be- 
side the old. This study should help to hasten that day. 


Birp T. BaLtpwin aNnpD Maporau Smita. Educational Research. 
Bureau of Education, Washington, D. C. Bulletin, 1923, No. 42. 

This is a classified bibliography of 572 titles of research articles pub- 
lished in American educational magazines and a few American books 
dated from 1920 to 1922 inclusive. Preceding the bibliography there are 
very brief summaries of the range and conclusions of the studies listed 
as well as mention of various foundations, experimental schools and 
periodicals which carry on research, or publish the reports of research. 

The definition of research used by the compilers does not include 
historical and philosophical researches. To historical students it may 
appear to be some slight consolation that, according to that definition 
this bulletin itself is not research for it is purely historical. 


H. G. Goon, 
Ohio University. 


Homer E. Cooper. Cost of Training Teachers. A Method of Deter- 
mining Cost and Its Application in the State of New York. Warwick 
and York. 112 pp. Price $1.60. 

This book is quite naturally of greatest interest to those interested 
in the training of teachers in the State of New York. The author has 
made a very careful study of the cost of training teachers in that state 
and of the extent to which the state is meeting the problem of supplying 
trained teachers for its schools. 

It is interesting to note that during the period from 1909 to 1921 the 
highest percentage of all certificates issued going to trained teachers 
was reached in the four periods from 1911 to 1915. In the period from 
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1919 to 1921 only 25 per cent of the certificates issued were issued to 
trained teachers. 


The methods used by the author in determining the cost of training 
teachers and the relation of the supply of teachers to the demand will 
be of interest to all persons interested in these problems. 


A. F. Myers, 


Ohio University. 


ArtTuur I. Gates. Psychology for Students of Education. Macmillan 
Company, 1923. Pp. 489. 

One would have some timidity in producing a book designed primar- 
ily as a text in the psychology of advertising and selling but which might 
also serve as a text in general psychology where such is needed! Yet, 
absurd as this would seem in connection with its business applications, 
psychology is even yet too commonly so treated in its educational bear- 
ings. Thus the author in this otherwise:excellent book states that, 
‘‘while the book has been written to satisfy the needs of students of 
education primarily, it may be found serviceable as an introductory 
text in general psychology.’’ The pity is that a job so well done could 
not have been worked out to contribute more directly and more prac- 
tically to the many problems prospective teachers must face, either with 
or without the aid they have a right to expect from the psychological 
instruction so often even forced upon them under the name of educa- 
tional psychology. 

The too common tendency of the past has been for our educational 
psychology to differ from general psychology in little but name. We 
have been inclined to feel that a knowledge of the general mental proc- 
esses, and the ideals of development in general is all that is necessary 
for their proper guidance, or, at least, that with this as a background the 
teacher can work out the details. The sad thing is that too often the 
teacher entering his practical work has little but background and that 
even here the ‘‘haze’’ is the most conspicuous part. He has been trained 
in the easy generalities and left to struggle through the difficult task of 
their detailed application unaided. 

While we can never, perhaps, hope to duplicate, in our instruction, the 
actual and specific problems the teacher will face in the field, still the 
closest approximation to these is desirable. Consequently those writing 
our texts in educational psychology should be less fearful about omitting 
many of the time-worn discussions of the general field (important though 
they may be there) and of searching out and dealing practically and in 
detail with the most important psychological problems occurring in the 
actual class room. We must realize more and more that we are training 
practical teachers, not laying the foundations for future ‘‘pure’’ psy- 
chologists. Thus, for example, the text in educational psychology 
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should give us more of the results of practical experimentation and 
demonstration of how children learn and retain their various number 
combinations, and of the shortcomings of our teaching of these things 
in the past and how they might, in the new light, be improved, rather 
than to spend the time explaining, in abstract and hypothetical neuro- 
logical terms the formation and retention of those bonds. The field is 
full of these insistent, practical problems. Why should we not shift the 
point of emphasis a little from the traditional toward the vital, practical 
considerations all teachers will have to meet? 

It is in the hope that Gates may have taken a bigger step in this direc- 
tion than examination of his book proves to be the case, that one feels 
disappointed. Yet comparatively he has done a very good job and the 
book should be welcomed as a real contribution by the hundreds of 
instructors looking for the best to be had in this field which admittedly 
needs a good deal of re-constructing and shifting of emphasis. In 
addition to the chapters dealing with the customary matters of sensory 
experiences and their gradual integrations into and with the higher 
ideational processes, he gives much space to the various phases of the 
learning process, original capacities, correlation of abilities, intelli- 
gence and its measurement, transference of training, teachers grades, 
etc. which, in their clean-cut treatment, will greatly aid the instructor 
whose plan is to make these things of real, functional value in the train- 
ing of teachers for actual, effective work in the field. 


F. B. Kniaut anp G. M. Rucna. Syllabus for a First Course in Educa- 
tional Psychology. Lowa Supply Company, Iowa City, Lowa, 1923. 
This manual has been written to supplement Gates’ Psychology for 
Students of Education. In the words of the authors, ‘“‘the lessons and 
assignments will follow this text closely. In the main each lesson in 
this syllabus will match a chapter in the text. It is therefore essential 
that the student spare no pains in the genuine mastery of each chapter. 
In preparing each chapter the student should be sure to do all that is 
asked for inthe syllabus.’’ It is plain, from the amount of work outlined 
for each lesson, as well as from the meager references to other sources, 
that intensive mastery of the text is what is desired. This, perhaps, isa 
good thing, stressing as it does the mastery of something, in the place of 
the too-common smattering over a broader field, yet it has its inherent 
dangers, in some hands, of unduly mechanizing or stereotyping the 
course and of creating the impression that the field of educational 
psychology and the contents of a book are synonymous. 

In substance, the authors claim two general advantages from the 
use of this syllabus: (1) a great saving of effort and time for instructors 
who are overburdened with large classes and heavy schedules, and (2) 
the formation of economical and effective habits of study on the part of 
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students using it. It is probable that anyone examining this syllabus 
carefully will feel that both of these advantages will be abundantly 
realized. The student conscientiously making the preparations as 
directed is bound to carry away from the course, not only many well 
selected facts but also an increased capacity for effective study, while 
the one who grudgingly makes his preparations can, with a minimum of 
trouble to the instructor, be urged into doing a grade of work otherwise 
impossible. 

Probably the most valuable features of the syllabus are the sugges- 
tions for study, m:ch at variance with the study concepts and habits 
of the average college student, yet in keeping with the best and latest 
findings on the matters of learning and of study. For the sake of brevity 
some of the more important of these will merely be listed: 

First, study of each lesson is to be broken into at least two periods; 
the first to get the facts from the text according to the syllabus outline 
for the chapter; the second for the review of these facts after a period of 
two or three hours have elapsed, and to re-read and correct any work thus 
found not to be well understood. This is a good start toward a spaced 
study or repetition seriously lacking in the average student’s study 
program. 

Second, in view of the near futility, for permanent retention, of a 
single reading it is interesting to note, time after time, instructions 
similar to the following for the study of the various chapters of the text: 
*‘(1) Read the sub-topics of the chapter in the table of contents, pp. 
xiii. Before reading the chapter spend a few minutes organizing what 
you already know concerning each topic listed on pp. xiii. Take time to 
frame for yourself questions, on each topic, that you expect the chapter 
to answer. (2) Read the entire chapter ‘for intellectual fun’; i.e., as 
though you were not to be tested upon your study but wanted to find 
out the facts for your own satisfaction. (3) Re-read the chapter with 
the notes (Section II) and the Class Preparation (Section III) in mind.” 
These are the instructions, in part, for the study of Lesson 11 in the 
Syllabus. 

These careful readings, with frequently two re-readings, for the 
general grasp of the contents of the lesson as well as for the solution 
of specific problems involved in it, cannot but greatly improve the 
general preparations, and attitudes toward preparations, of the stu- 
dents doingthem. As further incentives to good study, additional work 
is usually outlined for additional credit, though the exact nature of the 
additional credit does not seem to be specified. 

All through the syllabus are to be found many types of appropriate 
suggestions, exercises, questions, etc. to be worked out carefully and 
put in written form in spaces provided for their recording, and in addi- 
tion to these, a few of the most significant, from the standpoint of the 
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authors, of the questions and exercises following the chapters of the 
text are indicated for special study and recording in the manual. Not 
only are these exercises valuable as worthy content in themselves but, 
to the instructor who desires to add things of his own choosing to suit 
his special conditions and purposes, they are sources of valuable sugges- 
tion. The manual should receive a hearty welcome not only from those 
already using Gates’ Psychology, but should open the way for the 
adoption of that text by others who might otherwise hesitate in taking 
that action. 


Henry EastMANn BENNETT. Psychology and Self Development. Ginn 
and Company, 1923. Pp. 296. 

According to the author “the selection and rejection of material 
of this book has been an evolution in the classroom during many years 
of search for (1) that which will function directly in increasing the stu- 
dent’s capacity as a learner; (2) that which will afford the most useful 
basis for a course in teacher-training; (3) that which will best meet the 


-needs of a first course in college psychology; (4) that which, instead of 


merely skimming the cream of interest will definitely project the stu- 
dent’s interest and expectation toward a fuller and more adequate pur- 
suit of the subject; (5) that which will best help the young student to 
maintain his poise amid the dizzying enlargements of his mental 
horizon as he climbs the ascent of higher education and thinks he sees 
dark chasms yawning between his new knowledge and his old faith.’ 

With these purposes and ideals in mind, ‘‘a lot of territory”’ to pre- 
sume to cover in so brief a treatise, the author proceeds to express in 
simple and very readable language the generally accepted facts in the 
fields discussed, ‘“‘admitting nothing which is merely argumentative or 
speculative which is not essential to the scientific integrity of the whole 
plan or practically applicable to the needs of the learner, and to omit 
nothing which properly belongs to a thorough first course in psychology. 
The functional viewpoint and the physiological basis have been woven 
into every chapter. A close-knit system of treatment has been sought 
which explains all psychical phenomena in terms of associations and 
progressive integration and the conditions which forward or retard 
these.” 

Anything unusual or of special interest in the book, however, is to be 
found not in a survey of the table of contents, which is closely similar 
to that of the traditional introductory psychology, but to special ways 
of statement or treatment under these heads. The book commences 
with a chapter on ‘The Art of Learning”’ in which some valuable advice 
on study is given under such captions as, ‘‘Learn Strenuously,’’ ‘“‘Ques- 
tion Constantly,’ “Organize,’’ ‘‘Outline,”” “Learn to Take Notes,” 
etc., with the reminder that one’s practical problem is not to worry 
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about the native ability which has been given him but to make the most 
effective use of what he has. In the second chapter, under the heading, 
“The Basis of Learning”’ is a discussion of the customary facts of ele- 
mentary neurology. Chapters on ‘‘The Original Capital,’’ ‘‘Habit,” 
‘‘Sensation,’’ ‘‘Concepts,’’ ‘‘Judgments,”’ etc., follow. In these the 
point of view and treatment are usually consistent and up-to-date. 
For example, in his treatment of instinctive tendencies in man he states, 
“it is not usually any definite kind of act, but rather a vague tendency 
to a certain attitude under certain conditions. . . . . Few acts of 
mature life may be regarded as mainly instinctive, because of the larg 
element of learned activities which inevitably enter into them. Never- 
theless, there enter into all conduct of whatever kind some instinctive 
influences. Back of every thing we do is a cause in the form of that vital 
push, blind instinct more or less educated to rational efficiency. a 
Education gives the direction and form to one’s acts, but the reason 
for one’s acting at all, the primary thing that makes things go, the real 
motive power for all conduct, is found somewhere deep below the sur- 
face in these instinctive impulses (pp. 35-36).’’ Most parts of the book 
are thus very readable and will appeal to the beginning student, and, we 
believe, give him a desire for more about which he is reading, which 
cannot be said of all texts in psychology. 

The “‘sins’”’ of the book, if we may mention some of them are rather 
“sins of omission” than of ‘‘commission.’’ One is justly surprised in 
reading a book purporting to be a text in educational psychology, 
to find no mention in the index, and practically no mention if any in the 
body of the text, of such matters as general intelligence, intelligence 
testing, I.Q., individual differences, statistical methods, correlation, 
median, mean, etc. These are simply indicative of some of the vital 
considerations one would expect to find in a text in educational psychol- 
ogy. They are the very tools with which investigation that is worth 
while must largely be made. Things of almost equal importance have 
been omitted, from the standpoint of general psychology, so far as 
modern ‘‘moves”’ are concerned. This perhaps is due in some part to 
the too-common attempt to cover too much territory, in fields which are 
much more incompatible than has been imagined, in a treatise of the 
size of this text. 

Yet, in spite of these omissions, the book will be found to be of real 
value, at least as a supplementary text, for beginning college students. 


H. J. PETEeRson, 
Ohio University. 
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1 Mention here does not preclude further comment. 
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